-- Logs begin at Wed 2021-12-15 13:23:54 UTC, end at Wed 2021-12-15 14:53:49 UTC. -- Dec 15 13:55:05.904599 dv-cinder-821824-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 13:55:05.914221 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 13:55:05.916421 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 13:55:05 2021] *** Dec 15 13:55:05.916421 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 13:55:05.916421 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 13:55:05.916421 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: nodename: dv-cinder-821824-1-iscsi Dec 15 13:55:05.916421 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: machine: x86_64 Dec 15 13:55:05.916421 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: clock source: unix Dec 15 13:55:05.916421 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: pcre jit disabled Dec 15 13:55:05.916421 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: detected number of CPU cores: 4 Dec 15 13:55:05.916421 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: current working directory: / Dec 15 13:55:05.916421 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: detected binary path: /usr/bin/uwsgi-core Dec 15 13:55:05.916421 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: your processes number limit is 47680 Dec 15 13:55:05.916421 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: your memory page size is 4096 bytes Dec 15 13:55:05.916421 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: detected max file descriptor number: 2048 Dec 15 13:55:05.916421 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: lock engine: pthread robust mutexes Dec 15 13:55:05.917243 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: thunder lock: enabled Dec 15 13:55:05.917243 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 13:55:05.917243 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 13:55:05.961120 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: Python main interpreter initialized at 0x5590c1fbb9c0 Dec 15 13:55:05.961120 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: python threads support enabled Dec 15 13:55:05.961120 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: your server socket listen backlog is limited to 100 connections Dec 15 13:55:05.961120 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: your mercy for graceful operations on workers is 90 seconds Dec 15 13:55:05.961596 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 13:55:05.961596 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: *** Operational MODE: preforking *** Dec 15 13:55:05.961895 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: *** uWSGI is running in multiple interpreter mode *** Dec 15 13:55:05.961895 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: spawned uWSGI master process (pid: 101922) Dec 15 13:55:05.962115 dv-cinder-821824-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 13:55:05.963261 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: spawned uWSGI worker 1 (pid: 101923, cores: 1) Dec 15 13:55:05.963261 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: spawned uWSGI worker 2 (pid: 101924, cores: 1) Dec 15 13:55:05.963261 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 13:55:07.677647 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:55:07.677647 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: from cryptography.utils import int_from_bytes Dec 15 13:55:07.678350 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:55:07.678350 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: from cryptography.utils import int_from_bytes Dec 15 13:55:07.687824 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:55:07.687824 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: from cryptography.utils import int_from_bytes Dec 15 13:55:07.688363 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:55:07.688363 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: from cryptography.utils import int_from_bytes Dec 15 13:55:10.229709 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 13:55:10.230270 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 13:55:10.230408 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 13:55:10.230534 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 13:55:10.230889 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 13:55:10.230960 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 13:55:10.231033 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 13:55:10.231286 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 13:55:10.231418 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.231656 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 13:55:10.231819 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.231910 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 13:55:10.231991 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.232288 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.232429 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.232580 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.232671 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.232943 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.233065 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.233236 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.233337 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.233545 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.233702 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.233900 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.234030 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.234129 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.234317 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.234448 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.234641 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.234782 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821824-1-iscsi {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.234973 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.235123 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.235219 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.235300 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.235541 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.235686 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.235858 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821824-1-iscsi {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.235965 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.236181 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.236272 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.236492 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.236581 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.236804 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.236906 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.237217 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.237312 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.237527 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.237735 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.237868 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.238043 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.238159 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.238349 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.238656 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.238872 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.238956 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.239080 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.239275 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.239414 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.239592 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.239689 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.239894 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.239992 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.240213 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.240304 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.240519 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.240622 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.240845 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.240932 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821824-1-iscsi {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.241155 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.241257 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.241488 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.241578 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.241827 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.241919 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.242443 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.242671 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821824-1-iscsi {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.242767 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.242891 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.242983 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.243062 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.243187 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.243322 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.243512 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.243605 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.243818 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.243908 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.244142 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.244240 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.244461 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.244557 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.244774 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.244905 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.245094 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.245183 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.245395 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.245491 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.245727 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.245819 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.246037 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.246144 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.246350 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.246440 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.246655 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.246745 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.246964 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.247062 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.247197 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.247283 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.247505 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.247590 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.247825 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.247928 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.248144 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.248230 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.248403 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.248487 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.248698 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.248785 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.248943 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.249029 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.249257 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.249342 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.249576 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.249705 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.249905 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.249990 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.250156 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.250251 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.250792 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.250892 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.251107 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.251191 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.251413 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.251505 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.251721 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.251812 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.252017 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.252102 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.252320 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.252416 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.252627 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.252757 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.252937 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.253031 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.253247 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.253384 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.253550 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.253665 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.253893 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.253990 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.254211 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.254302 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.254519 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.254602 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.254823 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.254908 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.255143 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.255237 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.255454 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.255545 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.255761 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.255883 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.256078 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.256199 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.256394 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.256553 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.256701 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.256874 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.257010 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.257186 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.257314 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.257507 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.257679 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.257980 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.258329 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.258411 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.258492 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.258568 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.258644 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.258814 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.258904 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.259114 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.259235 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.259427 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.259573 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.259717 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.259882 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.260021 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.260134 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.260326 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.260439 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.260625 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.260747 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.260927 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.261068 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.261232 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.261378 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.261536 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.261716 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.261871 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.262027 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.262174 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.262331 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.262478 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.262641 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.262782 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.262952 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.263084 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.263261 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.263383 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.263572 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.263693 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.263882 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.264004 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.264191 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.264312 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.264529 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.264621 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.264906 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.265018 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.265205 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.265301 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.265521 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.265792 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.266073 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.266363 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.266572 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.266655 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.266740 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.266818 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.267111 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.267464 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.267685 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.267769 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.267933 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.268021 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.268102 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.268179 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.268264 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.268343 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.268420 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.268498 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.268574 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.268659 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.268763 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.268856 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.269076 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.269161 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.269381 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.269474 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.269773 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.269863 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.270074 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.270158 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.270377 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.270475 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.270685 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.270785 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.270979 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.271071 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.271276 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.271369 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.271576 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.271666 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.271871 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.271962 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.272175 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.272268 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.272483 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.272574 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.272788 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.272871 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.273091 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.273176 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.273458 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.273915 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.274012 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.274092 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.274178 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.274364 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.274450 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.274693 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.274778 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.275010 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.275104 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.275327 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.275412 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.275641 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.275726 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.275973 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:55:10.276059 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.276279 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.276363 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.276594 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.276686 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.276925 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.277011 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.277233 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.277317 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.277542 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.277685 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.277882 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.277969 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.278198 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.278284 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.278517 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.278609 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.278845 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.278948 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.279162 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.279253 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.279475 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.279571 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.279789 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.279919 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.280096 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.280191 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.280419 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.280511 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.280742 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.280829 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.281060 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.281152 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.281370 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.281467 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.281710 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.281798 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.282037 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.282122 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.282356 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.282449 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.282676 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.282770 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.282986 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.283079 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.283307 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.283400 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.283622 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.283707 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.283934 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.284018 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.284250 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.284343 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.284577 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.284669 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.284890 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.284975 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.285201 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.285288 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.285533 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.285632 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.285873 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.285971 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.286187 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.286273 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.286493 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.286577 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.286800 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.286885 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.287104 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.287198 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.287410 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.287503 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.287712 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.287797 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.288031 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.288116 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.288361 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.288510 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.288677 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.288800 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.289021 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.289124 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.289333 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.289660 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.289835 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.290031 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.290158 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.290331 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.290481 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.290617 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.290805 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.290948 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.291123 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.291253 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.291462 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.291601 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.291773 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.291919 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.292082 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.292217 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.292387 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.292517 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.292695 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.292824 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.292997 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.293091 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.293301 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.293437 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.293626 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.293715 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.293938 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.294096 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.294249 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.294335 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.294559 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.294655 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.294877 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.294968 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.295186 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.295271 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.295492 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.295579 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.295824 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.295909 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.296151 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.296244 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.296457 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.296542 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.296789 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.296895 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.297111 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.297209 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.297424 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.297519 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.297755 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.297846 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.298064 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.298168 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.298365 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.298461 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.298666 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.298752 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.298968 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.299068 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.299274 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.299369 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.299577 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.299670 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.299878 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.299965 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.300179 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.300274 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.300479 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.300566 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.300782 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.300869 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.301102 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.301188 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.301408 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.301494 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.301738 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.301828 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.302040 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.302135 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.302338 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.302424 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.302643 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.302742 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.302954 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.303041 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.303283 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.303395 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.303592 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.303679 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.303900 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.304004 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.304209 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.304319 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.304586 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.304671 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.304952 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.305034 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.305266 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.305400 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.305577 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.305795 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.305911 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.306143 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.306231 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.306468 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.306555 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.306799 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.306953 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.307116 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.307264 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.307421 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.307550 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.307738 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.307867 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.308044 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.308185 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.308358 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.308497 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.308658 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.308786 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.308990 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.309130 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.309273 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.309406 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.309593 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.309734 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.309931 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.310030 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.310255 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.310341 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.310566 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.310651 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.310876 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.310972 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.311183 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.311275 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.311494 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.311578 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.311802 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.311889 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.312109 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.312194 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.312425 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.312510 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.312734 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.312820 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.313048 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.313133 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.313353 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.313438 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.313704 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.313795 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.314013 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.314098 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.314326 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.314410 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.314625 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.314710 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.314934 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.315028 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.315251 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.315347 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.315577 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.315662 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.315881 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.315964 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.316191 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.316284 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.316507 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.316594 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.316820 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.316904 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.317126 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.317218 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.317433 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.317516 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.317760 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.317847 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.318066 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.318163 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.318376 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.318468 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.318695 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.318780 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.319006 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.319093 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.319316 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.319407 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.319619 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.319704 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.319941 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.320033 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.320370 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.320541 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.320926 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.321213 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.323435 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.323941 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.324043 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.324043 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.324211 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.324292 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.324292 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.324957 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.325114 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.325230 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.325336 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.325336 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.325565 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.325668 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.325668 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.325946 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.326029 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.326115 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.326195 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.326272 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.327286 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.327380 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.327461 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.327461 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.327461 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.327461 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.327461 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.327799 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.327884 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.327971 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.328049 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.328134 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.329696 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.329696 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.329696 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.329696 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.329696 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.330060 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.330139 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.330217 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.330303 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.330380 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.330446 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.330511 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.330575 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.330648 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.330729 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.330815 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.330893 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.330976 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.331059 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.331143 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.331232 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.331318 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.331396 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.331473 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.331549 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.331666 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.331762 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.331989 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.332095 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.332315 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.332426 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.332626 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.332718 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.332936 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.333047 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.333247 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.333355 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.333589 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.333704 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.333893 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.333981 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.334217 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.334309 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.334592 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.334838 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.334928 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.335198 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.335301 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.335507 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.335603 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.335875 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.335977 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.336200 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.336617 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.336736 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.336961 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.337063 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.337301 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.337399 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.337699 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.337798 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.337957 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.338114 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.338276 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.338591 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.338687 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.338902 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.339220 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.339315 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.339532 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.339872 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.340017 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.340152 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.340414 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.340628 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.340764 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.340900 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.341189 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.341398 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.341532 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.341781 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.341915 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.342099 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.342258 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.342398 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.342501 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.342740 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.342831 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.343051 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.343141 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.343367 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.343459 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.343662 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.343805 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.343976 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.344114 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.344311 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.344442 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.344620 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.344766 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.344933 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.345021 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.345240 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.345334 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.345561 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.345692 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.345894 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.345982 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.346223 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.346400 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.346533 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.346619 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.346839 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.346926 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.347146 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.347256 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.347453 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.347550 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.347789 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.347882 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.348093 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.348179 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.348398 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.348482 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.348713 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.348798 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.349025 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.349113 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.349332 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.349417 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.349669 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.349772 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.349988 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.350075 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.350295 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.350387 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.350600 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.350748 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.350905 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.350996 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.351216 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.351331 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.351798 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.352282 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.352958 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.353044 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.353124 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.353202 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.353289 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.353379 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.353459 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.353537 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.353658 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.353658 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.353794 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.353883 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.353951 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.354028 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.354104 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.354305 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.354396 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.354612 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.354706 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.354918 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.355055 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.355220 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.355360 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.355527 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.355656 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.355832 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.355975 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.356137 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.356275 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.356445 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.356575 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.356747 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.356881 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.357062 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.357204 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.357366 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.357516 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.357691 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.357793 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.357996 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.358093 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.358304 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.358517 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.358624 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.358829 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.358946 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.359140 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.359226 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.359457 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.359543 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.359788 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.359883 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.360089 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.360173 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.360395 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.360480 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.360698 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.360840 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.360999 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.361095 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.361304 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.361389 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.361640 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.361746 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.361948 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.362041 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.362249 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.362335 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.362557 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.362643 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.362858 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.362950 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.363161 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.363249 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.363461 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.363547 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.363768 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.363854 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.364068 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.364162 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.364368 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.364462 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.364669 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.364754 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.364971 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.365135 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.365281 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.365410 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.365578 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.365731 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.365973 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.366113 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.366277 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.366407 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.366580 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.366710 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.366885 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.367033 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.367585 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.367733 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.367820 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.368019 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.368107 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.368328 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.368641 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.368734 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.368958 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.369221 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.369307 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.369573 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.369814 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.369955 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.370217 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.370381 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.370534 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.370856 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.370972 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.371184 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.371509 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.371596 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.371836 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.371938 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.372146 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.372260 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.372461 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.372586 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.372777 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.372905 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.373092 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.373231 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.373405 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.373544 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.373741 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.373878 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.374171 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.374260 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.374491 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.374613 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.374810 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.374902 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.375123 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.375745 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.376062 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.376378 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.376689 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.376996 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.377088 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.377323 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.377410 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.377656 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.378164 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.378263 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.378346 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.378424 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.378503 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.378590 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.378706 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.378855 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.379008 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.379197 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.379345 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.379636 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.379769 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.379955 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.380085 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.380263 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.380407 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.380595 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.380723 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.380887 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.381013 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.381179 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.381293 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.381516 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.381670 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.381839 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.381930 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.382158 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.382273 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.382470 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.382666 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.382987 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.383077 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.383303 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.383399 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.383616 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.383706 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.383922 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.384018 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.384222 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.384533 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.384862 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.385171 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.385480 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.385821 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.386153 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.386461 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.386547 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.386787 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.386875 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.387189 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.387284 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.387507 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.387640 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.387818 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.387969 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.388238 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.388327 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.388552 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.388639 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.388868 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.388975 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.389198 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.389294 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.389521 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.389631 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.389880 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.389974 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.390184 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.390278 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.390503 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.390589 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.390818 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.390904 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.391146 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.391237 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.391473 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.391559 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.391787 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.391886 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.392093 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.392177 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.392399 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.392482 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.392722 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.392819 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.393033 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.393119 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.393340 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.393426 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.393666 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.393787 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.393994 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.394080 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.394306 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.394454 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.394629 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.394727 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.395009 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.395106 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.395339 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.395429 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.395642 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.395730 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.395951 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.396043 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.396266 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.396354 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.396576 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.396672 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.396885 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.396977 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.397211 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.397301 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.397523 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.397625 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.397879 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.398014 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.398215 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.398336 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.398552 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.398751 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.398847 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.399145 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.399231 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.399469 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.399559 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.399779 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.399878 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.400096 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.400181 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.400405 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.400491 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.400727 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.400820 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.401052 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.401152 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.401361 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.401459 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.401700 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.401791 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.402015 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.402102 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.402324 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.402418 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.402632 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.402720 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.402941 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.403028 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.403285 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.403372 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.403596 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.403684 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.403922 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.404009 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.404241 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.404333 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.404551 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.404664 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.404856 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.404952 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.405180 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.405301 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.405490 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.405584 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.405829 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.405923 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.406142 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.406242 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.406451 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.406558 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.406757 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.406872 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.407062 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.407185 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.407385 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.407499 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.407689 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.407807 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.408015 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.408162 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.408326 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.408422 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.408644 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.408731 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.408966 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.409054 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.409271 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.409367 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.409583 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.409710 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.409918 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.410006 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.410223 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.410318 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.410526 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.410612 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.410829 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.410924 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.411141 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.411228 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.411451 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.411555 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.411757 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.411844 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.412094 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.412179 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.412398 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.412496 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.412715 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.412800 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.413064 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.413151 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.413381 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.413475 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.413720 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.413866 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.414150 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.414246 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.414507 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.414628 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.414880 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.415015 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.415149 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.415285 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.415502 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.415635 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.415769 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.415906 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.416074 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.416213 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.416390 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.416525 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.416699 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.416830 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.417003 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.417137 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.417308 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.417443 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.417640 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.417777 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.417949 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.418084 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.418251 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.418512 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.418644 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.418845 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.418977 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.419161 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.419297 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.419432 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.419565 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.419730 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.419865 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.420071 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.420207 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.420375 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.420504 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.420687 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.420821 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.421000 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.421131 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.421317 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.421447 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.421648 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.421785 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.421971 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.422105 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.422300 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.422431 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.422625 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.422779 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.422946 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.423082 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.423267 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.423401 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.423585 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.423727 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.423901 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.424030 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.424215 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.424347 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.424529 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.424686 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.424852 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.424938 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.425148 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.425235 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.425479 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.425638 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.425806 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.425894 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.426121 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.426358 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.426487 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.426688 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.426775 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.427003 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.427097 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.427317 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.427412 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.427628 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.427723 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.427936 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.428030 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.428247 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.428333 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.428558 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.428645 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.428864 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.428950 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.429174 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.429261 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.429545 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.429679 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.429962 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.430049 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.430297 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.430384 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.430621 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.430753 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.431006 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.431143 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.431323 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.431462 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.431643 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.431800 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.431957 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.432130 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.432269 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.432461 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.432628 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.432781 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.432943 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.433103 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.433255 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.433431 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.433569 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.433765 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.433909 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.434075 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.434224 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.434388 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.434535 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.434702 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.434844 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.435014 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.435156 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.435339 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.435466 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.435661 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.435777 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.435969 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.436084 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.436291 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.436377 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.436603 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.436698 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.437000 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.437138 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.437331 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.437496 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.437679 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.437852 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.437995 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.438185 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.438309 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.438516 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.438615 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.438837 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.439126 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.439213 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.439439 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.439534 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.439756 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.439842 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.440066 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.440153 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.440383 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.440482 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.440698 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.440790 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.441004 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.441096 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.441314 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.441414 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.441639 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.441737 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.441948 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.442035 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.442254 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.442348 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.442560 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.442646 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.442862 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.442952 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.443186 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.443273 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.443494 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.443580 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.443796 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.443891 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.444102 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.444189 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.444409 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.444495 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.444715 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.444941 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.445065 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.445350 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.445446 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.445695 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.445851 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.446021 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.446118 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.446345 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.446432 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.446665 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.446752 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.447019 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.447106 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.447272 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.447363 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.447578 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.447664 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.447885 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.447974 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.448190 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.448283 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.448500 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.448588 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.448805 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.448894 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.449110 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.449221 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.449418 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.449504 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.449756 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.449848 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.450063 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.450152 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.450373 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.450470 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.450676 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.450774 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.451002 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.451089 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.451307 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.451402 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.451649 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.451858 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.451952 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.452213 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.452298 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.452517 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.452605 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.452822 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.452918 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.453131 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.453217 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.453434 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.453523 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.453773 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.453874 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.454077 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.454251 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.454384 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.454479 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.454688 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.454775 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.454999 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.455138 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.455304 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.455435 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.455614 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.455704 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.455921 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.456021 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.456241 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.456326 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.456541 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.456627 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.456845 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.456941 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.457154 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.457240 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.457460 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.457546 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.457808 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.457922 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.458119 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.458249 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.458427 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.458574 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.458784 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.458879 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.459092 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.459201 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.459518 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.459629 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.459831 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.460002 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.460145 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.460330 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.460457 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.460700 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.460855 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.461044 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.461210 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.461354 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.461530 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.461721 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.461880 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.461969 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.462292 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.462379 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.462604 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.462700 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.462917 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.463016 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.463230 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.463322 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.463538 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.463634 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.463846 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.463940 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.464155 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.464249 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.464462 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.464549 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.464769 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.464863 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.465076 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.465171 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.465389 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.465477 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.465751 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.465849 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.466070 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.466157 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.466389 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.466478 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.466695 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.466779 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.467002 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.467102 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.467311 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.467404 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.467621 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.467707 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.467927 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.468024 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.468236 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.468330 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.468552 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.468652 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.468884 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.468978 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.469195 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.469281 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.469499 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.469585 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.469852 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.469939 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.470178 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.470272 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.470504 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.470591 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.470822 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.470961 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.471134 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.471222 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.471453 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.471548 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.471768 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.471856 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.472076 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.472162 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.472388 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.472487 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.472694 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.472788 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.473003 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.473089 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.473317 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.473412 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.473667 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.473759 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.473993 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.474079 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.474297 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.474396 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.474601 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.474687 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.474904 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.474991 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.475211 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.475345 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.475538 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.475681 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.475850 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.475947 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.476169 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.476256 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.476531 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.476623 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.476848 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.476980 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.477165 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.477370 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.477458 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.477715 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.477805 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.478041 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.478142 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.478364 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.478451 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.478698 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.478784 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.479027 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.479114 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.479337 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.479431 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.479649 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.479789 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.479961 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.480050 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.480272 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.480359 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.480579 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.480704 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.480886 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.480982 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.481213 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.481302 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.481539 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.481646 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.481871 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.481962 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.482132 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 13:55:10.482226 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.482503 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.482819 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.483138 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.483448 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.483776 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.484085 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.484401 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.484712 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.485022 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.485337 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.485675 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.486001 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.486324 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.486647 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.486969 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.487312 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.487627 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.487968 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.488294 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.488607 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.488925 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.489216 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:55:10.489454 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 13:55:10.506103 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_db.sqlalchemy.engines [None req-8585466b-c6d6-4ae0-a3a9-0ed33d873b0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:55:10.512518 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG oslo_db.sqlalchemy.engines [None req-83ac3346-2fa5-48a9-b512-9f3945593655 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:55:10.574099 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.context [None req-8585466b-c6d6-4ae0-a3a9-0ed33d873b0c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff103318-e65e-4db9-8afc-ec27a2dfc0ea(cell1) {{(pid=101923) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 13:55:10.576736 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.context [None req-83ac3346-2fa5-48a9-b512-9f3945593655 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff103318-e65e-4db9-8afc-ec27a2dfc0ea(cell1) {{(pid=101924) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 13:55:10.578397 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_concurrency.lockutils [None req-8585466b-c6d6-4ae0-a3a9-0ed33d873b0c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:55:10.579985 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_concurrency.lockutils [None req-8585466b-c6d6-4ae0-a3a9-0ed33d873b0c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:55:10.580784 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_concurrency.lockutils [None req-8585466b-c6d6-4ae0-a3a9-0ed33d873b0c None None] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:55:10.581027 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG oslo_concurrency.lockutils [None req-83ac3346-2fa5-48a9-b512-9f3945593655 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:55:10.582664 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG oslo_concurrency.lockutils [None req-83ac3346-2fa5-48a9-b512-9f3945593655 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:55:10.582798 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_concurrency.lockutils [None req-8585466b-c6d6-4ae0-a3a9-0ed33d873b0c None None] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:55:10.583452 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG oslo_concurrency.lockutils [None req-83ac3346-2fa5-48a9-b512-9f3945593655 None None] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:55:10.585368 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG oslo_concurrency.lockutils [None req-83ac3346-2fa5-48a9-b512-9f3945593655 None None] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:55:10.593887 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_db.sqlalchemy.engines [None req-8585466b-c6d6-4ae0-a3a9-0ed33d873b0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:55:10.597648 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_db.sqlalchemy.engines [None req-8585466b-c6d6-4ae0-a3a9-0ed33d873b0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:55:10.601799 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG oslo_db.sqlalchemy.engines [None req-83ac3346-2fa5-48a9-b512-9f3945593655 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:55:10.604090 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG oslo_db.sqlalchemy.engines [None req-83ac3346-2fa5-48a9-b512-9f3945593655 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:55:10.767208 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG oslo_db.sqlalchemy.engines [None req-83ac3346-2fa5-48a9-b512-9f3945593655 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:55:10.768291 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_db.sqlalchemy.engines [None req-8585466b-c6d6-4ae0-a3a9-0ed33d873b0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:55:11.115621 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: WARNING keystonemiddleware.auth_token [None req-83ac3346-2fa5-48a9-b512-9f3945593655 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:55:11.116415 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: WARNING keystonemiddleware.auth_token [None req-8585466b-c6d6-4ae0-a3a9-0ed33d873b0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:55:11.123013 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: WARNING keystonemiddleware.auth_token [None req-83ac3346-2fa5-48a9-b512-9f3945593655 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:55:11.123367 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: WARNING keystonemiddleware.auth_token [None req-8585466b-c6d6-4ae0-a3a9-0ed33d873b0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:55:11.466636 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: WARNING keystonemiddleware.auth_token [None req-8585466b-c6d6-4ae0-a3a9-0ed33d873b0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:55:11.468733 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: WARNING keystonemiddleware.auth_token [None req-83ac3346-2fa5-48a9-b512-9f3945593655 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:55:11.471962 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: WARNING keystonemiddleware.auth_token [None req-8585466b-c6d6-4ae0-a3a9-0ed33d873b0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:55:11.474201 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: WARNING keystonemiddleware.auth_token [None req-83ac3346-2fa5-48a9-b512-9f3945593655 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:55:11.477214 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5590c1fbb9c0 pid: 101923 (default app) Dec 15 13:55:11.479313 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-8585466b-c6d6-4ae0-a3a9-0ed33d873b0c None None] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:55:11.479605 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5590c1fbb9c0 pid: 101924 (default app) Dec 15 13:55:11.480490 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-8585466b-c6d6-4ae0-a3a9-0ed33d873b0c None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001710 Dec 15 13:55:11.480936 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Wed Dec 15 13:55:11 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:56:35.285167 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-83ac3346-2fa5-48a9-b512-9f3945593655 None None] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:56:35.286403 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-83ac3346-2fa5-48a9-b512-9f3945593655 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001982 Dec 15 13:56:35.287319 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 930 bytes} [Wed Dec 15 13:56:35 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:56:35.732502 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-49a3072c-a8aa-43f7-bc31-058131f74e69 admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:56:35.764985 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-49a3072c-a8aa-43f7-bc31-058131f74e69 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.469082 Dec 15 13:56:35.764985 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 2/3] 10.222.0.42 () {60 vars in 1291 bytes} [Wed Dec 15 13:56:35 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:56:38.212471 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-83ac3346-2fa5-48a9-b512-9f3945593655 None None] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:56:38.213489 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-83ac3346-2fa5-48a9-b512-9f3945593655 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Dec 15 13:56:38.213915 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 2/4] 10.222.0.42 () {54 vars in 930 bytes} [Wed Dec 15 13:56:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:56:38.278934 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-3689eeaa-8109-47c1-808f-b0ce622f5ff7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "name": "cirros256", "disk": 1, "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:56:38.297119 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:56:38.297119 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: warnings.warn(msg) Dec 15 13:56:38.327339 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-3689eeaa-8109-47c1-808f-b0ce622f5ff7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106301 Dec 15 13:56:38.328174 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 3/5] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Dec 15 13:56:38 2021] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:56:38.557047 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-09516ece-deaa-4108-9d1e-8d607f13c77e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:56:38.559507 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:56:38.559507 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: warnings.warn(msg) Dec 15 13:56:38.610092 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-09516ece-deaa-4108-9d1e-8d607f13c77e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.272699 Dec 15 13:56:38.613656 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 3/6] 10.222.0.42 () {64 vars in 1335 bytes} [Wed Dec 15 13:56:38 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:56:41.042694 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-3689eeaa-8109-47c1-808f-b0ce622f5ff7 admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:56:41.043732 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-3689eeaa-8109-47c1-808f-b0ce622f5ff7 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Dec 15 13:56:41.044338 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 4/7] 10.222.0.42 () {54 vars in 930 bytes} [Wed Dec 15 13:56:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:56:41.170641 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-af5f226f-7088-47f8-a954-2ff418135af1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "disk": 5, "vcpus": 1, "name": "ds512M"}} {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:56:41.189691 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:56:41.189691 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: warnings.warn(msg) Dec 15 13:56:41.215623 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-af5f226f-7088-47f8-a954-2ff418135af1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.164752 Dec 15 13:56:41.216402 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 4/8] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Dec 15 13:56:41 2021] POST /compute/v2.1/flavors => generated 404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:56:41.228808 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-fac9adcb-ec94-4608-bf0f-f5a9ad3f7408 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:56:41.230306 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:56:41.230306 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: warnings.warn(msg) Dec 15 13:56:41.271412 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-fac9adcb-ec94-4608-bf0f-f5a9ad3f7408 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046498 Dec 15 13:56:41.272161 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 5/9] 10.222.0.42 () {64 vars in 1335 bytes} [Wed Dec 15 13:56:41 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:56:43.743631 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-af5f226f-7088-47f8-a954-2ff418135af1 admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:56:43.744602 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-af5f226f-7088-47f8-a954-2ff418135af1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Dec 15 13:56:43.745180 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 930 bytes} [Wed Dec 15 13:56:43 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:56:43.826374 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-4350ce62-0874-471c-a875-0c1787ee66e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 1024, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "id": "d2"}} {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:56:43.852966 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-4350ce62-0874-471c-a875-0c1787ee66e3 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.099995 Dec 15 13:56:43.853557 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 6/11] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Dec 15 13:56:43 2021] POST /compute/v2.1/flavors => generated 404 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:56:43.868328 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-da7d408a-73d5-4ec4-beb5-2070cd489200 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:56:43.897186 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-da7d408a-73d5-4ec4-beb5-2070cd489200 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034186 Dec 15 13:56:43.898413 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 6/12] 10.222.0.42 () {64 vars in 1335 bytes} [Wed Dec 15 13:56:43 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:56:46.420553 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-4350ce62-0874-471c-a875-0c1787ee66e3 admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:56:46.421570 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-4350ce62-0874-471c-a875-0c1787ee66e3 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Dec 15 13:56:46.422092 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 7/13] 10.222.0.42 () {54 vars in 930 bytes} [Wed Dec 15 13:56:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:56:46.487116 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-bda79404-1528-4f3e-945e-9009446e6021 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "id": "d3", "name": "ds2G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:56:46.508555 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-bda79404-1528-4f3e-945e-9009446e6021 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079983 Dec 15 13:56:46.509015 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 7/14] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Dec 15 13:56:46 2021] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:56:46.521330 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-df9eba4b-b1b8-4bd4-b4be-09cbe34e370a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:56:46.548023 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-df9eba4b-b1b8-4bd4-b4be-09cbe34e370a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030354 Dec 15 13:56:46.548622 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 8/15] 10.222.0.42 () {64 vars in 1335 bytes} [Wed Dec 15 13:56:46 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:56:49.016630 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-bda79404-1528-4f3e-945e-9009446e6021 admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:56:49.017753 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-bda79404-1528-4f3e-945e-9009446e6021 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Dec 15 13:56:49.018424 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 8/16] 10.222.0.42 () {54 vars in 930 bytes} [Wed Dec 15 13:56:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:56:49.080061 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-08668609-4928-4519-878b-edee67449a7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G", "disk": 20, "swap": 0, "ram": 4096, "id": "d4"}} {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:56:49.101017 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-08668609-4928-4519-878b-edee67449a7c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075390 Dec 15 13:56:49.106471 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 9/17] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Dec 15 13:56:49 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:56:49.114713 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-d7a3b445-d692-4b52-8d6d-bf404442e1af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:56:49.141932 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-d7a3b445-d692-4b52-8d6d-bf404442e1af admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031378 Dec 15 13:56:49.143010 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 9/18] 10.222.0.42 () {64 vars in 1335 bytes} [Wed Dec 15 13:56:49 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:56:51.611556 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-08668609-4928-4519-878b-edee67449a7c admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:56:51.612774 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-08668609-4928-4519-878b-edee67449a7c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001669 Dec 15 13:56:51.613244 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 10/19] 10.222.0.42 () {54 vars in 930 bytes} [Wed Dec 15 13:56:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:56:51.679619 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-596ed0cf-1ce4-4d16-af1f-5833796fa28c admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:56:51.709523 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-596ed0cf-1ce4-4d16-af1f-5833796fa28c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088886 Dec 15 13:56:51.710787 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 10/20] 10.222.0.42 () {60 vars in 1291 bytes} [Wed Dec 15 13:56:51 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:56:54.695602 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-08668609-4928-4519-878b-edee67449a7c admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:56:54.696658 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-08668609-4928-4519-878b-edee67449a7c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Dec 15 13:56:54.697034 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 11/21] 10.222.0.42 () {54 vars in 930 bytes} [Wed Dec 15 13:56:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:56:54.761164 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-fcd97c1e-cdca-4a73-9816-bcdcf3105d77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "swap": 0, "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:56:54.783014 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-fcd97c1e-cdca-4a73-9816-bcdcf3105d77 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078377 Dec 15 13:56:54.783610 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 11/22] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Dec 15 13:56:54 2021] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:56:54.796721 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-889ff2cf-20be-465e-8ae8-9573bb9e1da1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:56:54.822091 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-889ff2cf-20be-465e-8ae8-9573bb9e1da1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028966 Dec 15 13:56:54.822691 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 12/23] 10.222.0.42 () {64 vars in 1332 bytes} [Wed Dec 15 13:56:54 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:56:57.322376 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-fcd97c1e-cdca-4a73-9816-bcdcf3105d77 admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:56:57.323381 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-fcd97c1e-cdca-4a73-9816-bcdcf3105d77 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Dec 15 13:56:57.323781 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 12/24] 10.222.0.42 () {54 vars in 930 bytes} [Wed Dec 15 13:56:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:56:57.386589 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-1adefb0b-09bd-4cc8-ac19-b801cfe182d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "name": "m1.small", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 1, "id": "2", "rxtx_factor": 1.0}} {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:56:57.405384 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-1adefb0b-09bd-4cc8-ac19-b801cfe182d4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074831 Dec 15 13:56:57.406394 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 13/25] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Dec 15 13:56:57 2021] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:56:57.418616 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-7161cb82-22c1-449e-a36d-59417847791d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:56:57.444253 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-7161cb82-22c1-449e-a36d-59417847791d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029005 Dec 15 13:56:57.445131 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 13/26] 10.222.0.42 () {64 vars in 1332 bytes} [Wed Dec 15 13:56:57 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:56:59.870089 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-1adefb0b-09bd-4cc8-ac19-b801cfe182d4 admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:56:59.871140 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-1adefb0b-09bd-4cc8-ac19-b801cfe182d4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Dec 15 13:56:59.871868 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 14/27] 10.222.0.42 () {54 vars in 930 bytes} [Wed Dec 15 13:56:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:56:59.948239 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-bbe44ca2-a14e-4bba-a304-497741906df6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "disk": 40, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "3"}} {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:56:59.971505 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-bbe44ca2-a14e-4bba-a304-497741906df6 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.092958 Dec 15 13:56:59.972376 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 14/28] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Dec 15 13:56:59 2021] POST /compute/v2.1/flavors => generated 406 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:56:59.984662 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-ce81c91f-f9da-40ee-acb5-8aeef877d634 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:57:00.011493 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-ce81c91f-f9da-40ee-acb5-8aeef877d634 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030478 Dec 15 13:57:00.012340 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 15/29] 10.222.0.42 () {64 vars in 1332 bytes} [Wed Dec 15 13:56:59 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:57:02.474315 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-bbe44ca2-a14e-4bba-a304-497741906df6 admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:02.475418 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-bbe44ca2-a14e-4bba-a304-497741906df6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Dec 15 13:57:02.476068 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 15/30] 10.222.0.42 () {54 vars in 930 bytes} [Wed Dec 15 13:57:02 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:57:02.539205 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-a283836a-2326-4b4d-a77b-35aaef1f268c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "id": "4", "rxtx_factor": 1.0, "disk": 80, "ram": 8192, "swap": 0}} {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:57:02.558812 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-a283836a-2326-4b4d-a77b-35aaef1f268c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076284 Dec 15 13:57:02.559627 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 16/31] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Dec 15 13:57:02 2021] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:57:02.572376 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-b1fe4f01-3dfc-4119-b5f0-4de3ab522ea7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:57:02.602149 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-b1fe4f01-3dfc-4119-b5f0-4de3ab522ea7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033807 Dec 15 13:57:02.603041 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 16/32] 10.222.0.42 () {64 vars in 1332 bytes} [Wed Dec 15 13:57:02 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:57:05.053445 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-a283836a-2326-4b4d-a77b-35aaef1f268c admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:05.054507 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-a283836a-2326-4b4d-a77b-35aaef1f268c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001790 Dec 15 13:57:05.055382 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 17/33] 10.222.0.42 () {54 vars in 930 bytes} [Wed Dec 15 13:57:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:57:05.123303 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-12f85111-3915-4e8b-8d42-a800d30ad630 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "disk": 160, "ram": 16384, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:57:05.143705 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-12f85111-3915-4e8b-8d42-a800d30ad630 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.081383 Dec 15 13:57:05.144470 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 17/34] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Dec 15 13:57:05 2021] POST /compute/v2.1/flavors => generated 408 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:57:05.157404 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-d9038fcd-7fd7-4370-bc88-6ff06b8aba8a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:57:05.186175 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-d9038fcd-7fd7-4370-bc88-6ff06b8aba8a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032435 Dec 15 13:57:05.201638 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 18/35] 10.222.0.42 () {64 vars in 1332 bytes} [Wed Dec 15 13:57:05 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:57:25.556576 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-12f85111-3915-4e8b-8d42-a800d30ad630 admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:25.557581 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-12f85111-3915-4e8b-8d42-a800d30ad630 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Dec 15 13:57:25.558014 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 18/36] 10.222.0.42 () {54 vars in 930 bytes} [Wed Dec 15 13:57:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:57:25.630999 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-5e17819a-124b-4229-8e2c-07841161a167 admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:25.648899 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-5e17819a-124b-4229-8e2c-07841161a167 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.083717 Dec 15 13:57:25.649438 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 19/37] 10.222.0.42 () {60 vars in 1291 bytes} [Wed Dec 15 13:57:25 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:57:27.270220 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-12f85111-3915-4e8b-8d42-a800d30ad630 admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:27.271490 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-12f85111-3915-4e8b-8d42-a800d30ad630 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001962 Dec 15 13:57:27.272098 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 19/38] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Dec 15 13:57:27 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:57:27.479469 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-f8e33826-e7a4-40f1-a425-8c241e839558 admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:27.485971 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.wsgi [None req-f8e33826-e7a4-40f1-a425-8c241e839558 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 13:57:27.486548 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-f8e33826-e7a4-40f1-a425-8c241e839558 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:57:27.487358 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-f8e33826-e7a4-40f1-a425-8c241e839558 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.075885 Dec 15 13:57:27.487907 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 20/39] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Dec 15 13:57:27 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 13:57:27.498757 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-f736b982-6e17-4362-98af-efc7c8b60550 admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:27.520619 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-f736b982-6e17-4362-98af-efc7c8b60550 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025772 Dec 15 13:57:27.521157 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 20/40] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Dec 15 13:57:27 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:57:27.534758 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-9a827e13-e043-411e-baf0-8d6efb3f4d43 admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:27.556125 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-9a827e13-e043-411e-baf0-8d6efb3f4d43 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025058 Dec 15 13:57:27.556725 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 21/41] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Dec 15 13:57:27 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:57:27.567125 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-d9a3334c-8a91-4afc-98df-baa7e5c850fa admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:27.572858 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.wsgi [None req-d9a3334c-8a91-4afc-98df-baa7e5c850fa admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 13:57:27.573421 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-d9a3334c-8a91-4afc-98df-baa7e5c850fa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:57:27.574242 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-d9a3334c-8a91-4afc-98df-baa7e5c850fa admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010870 Dec 15 13:57:27.574740 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 21/42] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Dec 15 13:57:27 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 13:57:29.089498 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-9a827e13-e043-411e-baf0-8d6efb3f4d43 admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:29.090565 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-9a827e13-e043-411e-baf0-8d6efb3f4d43 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Dec 15 13:57:29.090958 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 22/43] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Dec 15 13:57:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:57:29.296059 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-bb253498-280f-4df5-9e51-9eaab4de347f admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:29.301475 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.wsgi [None req-bb253498-280f-4df5-9e51-9eaab4de347f admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 13:57:29.302083 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-bb253498-280f-4df5-9e51-9eaab4de347f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:57:29.302865 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-bb253498-280f-4df5-9e51-9eaab4de347f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.072699 Dec 15 13:57:29.303655 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 22/44] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Dec 15 13:57:29 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 13:57:29.313882 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-9e389c0a-6319-49cf-9150-f92f74644f4e admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:29.327729 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-9e389c0a-6319-49cf-9150-f92f74644f4e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017529 Dec 15 13:57:29.328250 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 23/45] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Dec 15 13:57:29 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:57:29.339408 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-c22cc0e2-ef4b-4cd7-961b-82c9384ce282 admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:29.355742 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-c22cc0e2-ef4b-4cd7-961b-82c9384ce282 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020396 Dec 15 13:57:29.356515 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 23/46] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Dec 15 13:57:29 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:57:29.370401 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-ba4ee390-7531-4c75-9859-ecdc6c3b671e admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:29.376673 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.wsgi [None req-ba4ee390-7531-4c75-9859-ecdc6c3b671e admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 13:57:29.377237 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-ba4ee390-7531-4c75-9859-ecdc6c3b671e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:57:29.378056 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-ba4ee390-7531-4c75-9859-ecdc6c3b671e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011281 Dec 15 13:57:29.378559 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 24/47] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Dec 15 13:57:29 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 13:57:30.887623 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-c22cc0e2-ef4b-4cd7-961b-82c9384ce282 admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:30.888683 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-c22cc0e2-ef4b-4cd7-961b-82c9384ce282 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Dec 15 13:57:30.889060 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 24/48] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Dec 15 13:57:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:57:31.088462 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-0c6bcef7-30ea-4885-83e8-cde36806bc90 admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:31.096527 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.wsgi [None req-0c6bcef7-30ea-4885-83e8-cde36806bc90 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 13:57:31.097366 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-0c6bcef7-30ea-4885-83e8-cde36806bc90 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:57:31.098689 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-0c6bcef7-30ea-4885-83e8-cde36806bc90 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.072419 Dec 15 13:57:31.099507 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 25/49] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Dec 15 13:57:31 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 13:57:31.109880 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-dd223747-5e7e-4dc2-ac20-8d8387764c48 admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:31.124284 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-dd223747-5e7e-4dc2-ac20-8d8387764c48 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017904 Dec 15 13:57:31.124731 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 25/50] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Dec 15 13:57:31 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:57:31.137301 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-ecc7e3b1-e7c1-44b5-a2b8-5dd5055eccbd admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:31.150763 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-ecc7e3b1-e7c1-44b5-a2b8-5dd5055eccbd admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018952 Dec 15 13:57:31.151309 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 26/51] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Dec 15 13:57:31 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:57:31.161620 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-a508a139-38f8-4916-bc27-6d9908c04f14 admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:31.167501 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.wsgi [None req-a508a139-38f8-4916-bc27-6d9908c04f14 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 13:57:31.168060 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-a508a139-38f8-4916-bc27-6d9908c04f14 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:57:31.168836 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-a508a139-38f8-4916-bc27-6d9908c04f14 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010873 Dec 15 13:57:31.169324 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 26/52] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Dec 15 13:57:31 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 15 13:57:32.660279 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-ecc7e3b1-e7c1-44b5-a2b8-5dd5055eccbd admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:32.661315 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-ecc7e3b1-e7c1-44b5-a2b8-5dd5055eccbd admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Dec 15 13:57:32.661735 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 27/53] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Dec 15 13:57:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:57:32.875871 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-9351100a-d943-4ddd-9994-89878ed41056 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:57:32.897110 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-9351100a-d943-4ddd-9994-89878ed41056 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.082106 Dec 15 13:57:32.897682 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 27/54] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Dec 15 13:57:32 2021] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:57:34.449315 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-ecc7e3b1-e7c1-44b5-a2b8-5dd5055eccbd admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:34.450344 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-ecc7e3b1-e7c1-44b5-a2b8-5dd5055eccbd admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Dec 15 13:57:34.450742 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Dec 15 13:57:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:57:34.648838 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-b6264124-cf1e-44a4-b201-8294f8bce19d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:57:34.669009 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-b6264124-cf1e-44a4-b201-8294f8bce19d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.074684 Dec 15 13:57:34.669551 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 28/56] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Dec 15 13:57:34 2021] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:57:36.181050 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-ecc7e3b1-e7c1-44b5-a2b8-5dd5055eccbd admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:36.182101 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-ecc7e3b1-e7c1-44b5-a2b8-5dd5055eccbd admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Dec 15 13:57:36.182492 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 29/57] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Dec 15 13:57:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:57:36.382494 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-8baef758-cda8-4096-b871-31c23d0c0720 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:57:36.404337 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-8baef758-cda8-4096-b871-31c23d0c0720 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.078719 Dec 15 13:57:36.404930 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 29/58] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Dec 15 13:57:36 2021] POST /compute/v2.1/flavors => generated 407 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:57:37.927655 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-ecc7e3b1-e7c1-44b5-a2b8-5dd5055eccbd admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:37.928897 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-ecc7e3b1-e7c1-44b5-a2b8-5dd5055eccbd admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Dec 15 13:57:37.929332 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 30/59] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Dec 15 13:57:37 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:57:38.142727 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-699ed34c-eae7-4b7f-978c-a92105277353 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:57:38.164699 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-699ed34c-eae7-4b7f-978c-a92105277353 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.091156 Dec 15 13:57:38.165554 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 30/60] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Dec 15 13:57:38 2021] POST /compute/v2.1/flavors => generated 409 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:57:39.670964 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-ecc7e3b1-e7c1-44b5-a2b8-5dd5055eccbd admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:39.671964 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-ecc7e3b1-e7c1-44b5-a2b8-5dd5055eccbd admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Dec 15 13:57:39.672394 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 31/61] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Dec 15 13:57:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:57:39.872862 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-d822f6f6-93a8-4d0f-bfa2-d1b0a5dadf82 admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:57:39.893094 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-d822f6f6-93a8-4d0f-bfa2-d1b0a5dadf82 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.083282 Dec 15 13:57:39.893567 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 31/62] 10.222.0.42 () {60 vars in 1202 bytes} [Wed Dec 15 13:57:39 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:58:28.719792 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-ecc7e3b1-e7c1-44b5-a2b8-5dd5055eccbd admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:58:28.721299 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-ecc7e3b1-e7c1-44b5-a2b8-5dd5055eccbd admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002214 Dec 15 13:58:28.721916 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 32/63] 10.222.0.42 () {54 vars in 930 bytes} [Wed Dec 15 13:58:28 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:58:28.795582 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-7d364e18-b26b-4b53-901c-a7ef64f52107 admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:58:28.814882 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-7d364e18-b26b-4b53-901c-a7ef64f52107 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.085752 Dec 15 13:58:28.815426 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 32/64] 10.222.0.42 () {60 vars in 1291 bytes} [Wed Dec 15 13:58:28 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:58:28.837841 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-a000f8a1-b6df-4b23-b3ef-1dc1b7372451 admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:58:28.845783 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-a000f8a1-b6df-4b23-b3ef-1dc1b7372451 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011825 Dec 15 13:58:28.846304 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 33/65] 10.222.0.42 () {60 vars in 1282 bytes} [Wed Dec 15 13:58:28 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:58:28.860112 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-a896a652-4b04-4272-86c2-81c1f7ef1097 admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:58:28.868870 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-a896a652-4b04-4272-86c2-81c1f7ef1097 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012336 Dec 15 13:58:28.869407 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 33/66] 10.222.0.42 () {60 vars in 1285 bytes} [Wed Dec 15 13:58:28 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:58:28.883460 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-5f2e49b6-d20d-410b-ab6e-c3ee7c094290 admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:58:28.896066 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-5f2e49b6-d20d-410b-ab6e-c3ee7c094290 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016416 Dec 15 13:58:28.896766 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 34/67] 10.222.0.42 () {60 vars in 1285 bytes} [Wed Dec 15 13:58:28 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:58:28.908758 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-21e9f957-cc1d-4963-8112-381bd044e11e admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:58:28.917177 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-21e9f957-cc1d-4963-8112-381bd044e11e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012016 Dec 15 13:58:28.917722 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 34/68] 10.222.0.42 () {60 vars in 1282 bytes} [Wed Dec 15 13:58:28 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:59:54.818315 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-6ef5e6d9-28b8-4a0e-8ba7-b65b7244081d tempest-verify_tempest_config-1621502181 tempest-verify_tempest_config-1621502181-project] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:59:54.820284 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-6ef5e6d9-28b8-4a0e-8ba7-b65b7244081d tempest-verify_tempest_config-1621502181 tempest-verify_tempest_config-1621502181-project] 10.222.0.42 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.138046 Dec 15 13:59:54.821024 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 35/69] 10.222.0.42 () {58 vars in 1133 bytes} [Wed Dec 15 13:59:54 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:01:23.590462 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-21e9f957-cc1d-4963-8112-381bd044e11e admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:01:23.591492 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-21e9f957-cc1d-4963-8112-381bd044e11e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Dec 15 14:01:23.591906 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 35/70] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Dec 15 14:01:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:01:23.857778 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-b3bf9f9c-769b-4819-a8c6-9b27678a9ef9 admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:01:23.858957 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:01:23.858957 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: warnings.warn(msg) Dec 15 14:01:23.860512 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_concurrency.lockutils [None req-b3bf9f9c-769b-4819-a8c6-9b27678a9ef9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:01:23.860967 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_concurrency.lockutils [None req-b3bf9f9c-769b-4819-a8c6-9b27678a9ef9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:01:23.861781 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_concurrency.lockutils [None req-b3bf9f9c-769b-4819-a8c6-9b27678a9ef9 admin admin] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:01:23.862203 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_concurrency.lockutils [None req-b3bf9f9c-769b-4819-a8c6-9b27678a9ef9 admin admin] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:01:23.898420 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-b3bf9f9c-769b-4819-a8c6-9b27678a9ef9 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.166023 Dec 15 14:01:23.898978 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 36/71] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Dec 15 14:01:23 2021] GET /compute/v2.1/os-services => generated 791 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:01:25.420527 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-21e9f957-cc1d-4963-8112-381bd044e11e admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:01:25.421547 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-21e9f957-cc1d-4963-8112-381bd044e11e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Dec 15 14:01:25.421989 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 36/72] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Dec 15 14:01:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:01:25.620754 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-47481dc1-c407-428d-9be8-198634393b33 admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:01:25.621895 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:01:25.621895 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: warnings.warn(msg) Dec 15 14:01:25.623522 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_concurrency.lockutils [None req-47481dc1-c407-428d-9be8-198634393b33 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:01:25.623872 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_concurrency.lockutils [None req-47481dc1-c407-428d-9be8-198634393b33 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:01:25.624801 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_concurrency.lockutils [None req-47481dc1-c407-428d-9be8-198634393b33 admin admin] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:01:25.625232 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_concurrency.lockutils [None req-47481dc1-c407-428d-9be8-198634393b33 admin admin] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:01:25.649993 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-47481dc1-c407-428d-9be8-198634393b33 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085408 Dec 15 14:01:25.650562 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 37/73] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Dec 15 14:01:25 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:01:37.634929 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-21e9f957-cc1d-4963-8112-381bd044e11e admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:01:37.636040 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-21e9f957-cc1d-4963-8112-381bd044e11e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Dec 15 14:01:37.636434 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 37/74] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Dec 15 14:01:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:01:37.833465 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-e20d9c7f-84e4-4da9-99a7-15e3f156bf58 admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:01:37.834650 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:01:37.834650 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: warnings.warn(msg) Dec 15 14:01:37.836138 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_concurrency.lockutils [None req-e20d9c7f-84e4-4da9-99a7-15e3f156bf58 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:01:37.836571 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_concurrency.lockutils [None req-e20d9c7f-84e4-4da9-99a7-15e3f156bf58 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:01:37.837367 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_concurrency.lockutils [None req-e20d9c7f-84e4-4da9-99a7-15e3f156bf58 admin admin] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:01:37.837814 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_concurrency.lockutils [None req-e20d9c7f-84e4-4da9-99a7-15e3f156bf58 admin admin] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:01:37.859257 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-e20d9c7f-84e4-4da9-99a7-15e3f156bf58 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082504 Dec 15 14:01:37.859805 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 38/75] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Dec 15 14:01:37 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:01:39.398383 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: DEBUG nova.api.openstack.wsgi [None req-21e9f957-cc1d-4963-8112-381bd044e11e admin admin] Calling method '>' {{(pid=101924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:01:39.399505 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: INFO nova.api.openstack.requestlog [None req-21e9f957-cc1d-4963-8112-381bd044e11e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001650 Dec 15 14:01:39.399907 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: [pid: 101924|app: 0|req: 38/76] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Dec 15 14:01:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:01:39.610760 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG nova.api.openstack.wsgi [None req-ec07b5d6-cc2c-451a-9e85-6edfeecc6775 admin admin] Calling method '>' {{(pid=101923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:01:39.617218 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:01:39.617218 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: warnings.warn(msg) Dec 15 14:01:39.618801 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_concurrency.lockutils [None req-ec07b5d6-cc2c-451a-9e85-6edfeecc6775 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:01:39.619247 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_concurrency.lockutils [None req-ec07b5d6-cc2c-451a-9e85-6edfeecc6775 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:01:39.620042 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_concurrency.lockutils [None req-ec07b5d6-cc2c-451a-9e85-6edfeecc6775 admin admin] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:01:39.620464 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: DEBUG oslo_concurrency.lockutils [None req-ec07b5d6-cc2c-451a-9e85-6edfeecc6775 admin admin] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:01:39.644838 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: INFO nova.api.openstack.requestlog [None req-ec07b5d6-cc2c-451a-9e85-6edfeecc6775 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.102413 Dec 15 14:01:39.645413 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: [pid: 101923|app: 0|req: 39/77] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Dec 15 14:01:39 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:02:36.267217 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: Wed Dec 15 14:02:36 2021 - graceful shutdown triggered... Dec 15 14:02:36.266970 dv-cinder-821824-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 15 14:02:36.268201 dv-cinder-821824-1-iscsi devstack@n-api.service[101924]: Gracefully killing worker 2 (pid: 101924)... Dec 15 14:02:36.268569 dv-cinder-821824-1-iscsi devstack@n-api.service[101923]: Gracefully killing worker 1 (pid: 101923)... Dec 15 14:02:37.268166 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: worker 1 buried after 1 seconds Dec 15 14:02:37.268166 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: worker 2 buried after 1 seconds Dec 15 14:02:37.268166 dv-cinder-821824-1-iscsi devstack@n-api.service[101922]: goodbye to uWSGI. Dec 15 14:02:37.270666 dv-cinder-821824-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 15 14:02:37.271565 dv-cinder-821824-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 15 14:02:37.276016 dv-cinder-821824-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 14:02:37.288252 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 14:02:37.290359 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 14:02:37 2021] *** Dec 15 14:02:37.290359 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 14:02:37.290359 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 14:02:37.290359 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: nodename: dv-cinder-821824-1-iscsi Dec 15 14:02:37.290359 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: machine: x86_64 Dec 15 14:02:37.290359 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: clock source: unix Dec 15 14:02:37.290359 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: pcre jit disabled Dec 15 14:02:37.290359 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: detected number of CPU cores: 4 Dec 15 14:02:37.290359 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: current working directory: / Dec 15 14:02:37.290359 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: detected binary path: /usr/bin/uwsgi-core Dec 15 14:02:37.291103 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: your processes number limit is 47680 Dec 15 14:02:37.291103 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: your memory page size is 4096 bytes Dec 15 14:02:37.291103 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: detected max file descriptor number: 2048 Dec 15 14:02:37.291103 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: lock engine: pthread robust mutexes Dec 15 14:02:37.291103 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: thunder lock: enabled Dec 15 14:02:37.291103 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 14:02:37.291103 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 14:02:37.337531 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: Python main interpreter initialized at 0x55ed8d4e79c0 Dec 15 14:02:37.337531 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: python threads support enabled Dec 15 14:02:37.337531 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: your server socket listen backlog is limited to 100 connections Dec 15 14:02:37.337531 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: your mercy for graceful operations on workers is 90 seconds Dec 15 14:02:37.338021 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 14:02:37.338021 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: *** Operational MODE: preforking *** Dec 15 14:02:37.338264 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: *** uWSGI is running in multiple interpreter mode *** Dec 15 14:02:37.338264 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: spawned uWSGI master process (pid: 116088) Dec 15 14:02:37.338486 dv-cinder-821824-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 14:02:37.339371 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: spawned uWSGI worker 1 (pid: 116103, cores: 1) Dec 15 14:02:37.339489 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: spawned uWSGI worker 2 (pid: 116104, cores: 1) Dec 15 14:02:37.339564 dv-cinder-821824-1-iscsi devstack@n-api.service[116088]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 14:02:39.228235 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 14:02:39.228235 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: from cryptography.utils import int_from_bytes Dec 15 14:02:39.228978 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 14:02:39.228978 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: from cryptography.utils import int_from_bytes Dec 15 14:02:39.238395 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 14:02:39.238395 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: from cryptography.utils import int_from_bytes Dec 15 14:02:39.238996 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 14:02:39.238996 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: from cryptography.utils import int_from_bytes Dec 15 14:02:41.641786 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 14:02:41.642435 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 14:02:41.642531 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 14:02:41.642884 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 14:02:41.643141 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 14:02:41.643554 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.643874 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.644188 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.644507 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.644836 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.645140 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.645448 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.645790 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.646112 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.646357 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.646682 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.647002 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821824-1-iscsi {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.647318 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.647620 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.647924 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.648236 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.648532 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.648853 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.649146 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.649691 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.651608 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.652146 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.652675 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.653241 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.653809 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.654342 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.654872 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.655369 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.655843 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.656199 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.656664 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821824-1-iscsi {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.657037 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.657648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.657816 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.658131 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.658505 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.658806 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.659148 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.659453 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.659778 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.660097 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.660416 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.660736 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.661087 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.661425 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.661780 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.662086 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.662402 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.662709 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.663007 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.663256 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.663565 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.663883 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.664197 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.664519 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.664767 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.665013 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.665309 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.665642 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.665958 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.666264 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.666579 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.666886 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.667187 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.667488 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.667791 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.668087 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.668406 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.668717 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.669039 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.669343 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.669690 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.670085 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.670333 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.670637 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.670972 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.671287 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.671591 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.671908 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.672222 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.672690 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.672954 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.673149 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.673474 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.673866 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.674258 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.674434 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.674685 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.674987 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.675297 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.675585 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.675896 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.676200 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.676449 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.676757 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.677063 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.677393 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.677725 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.678031 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.678338 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.678728 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.678888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.679211 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.679522 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.679934 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.680220 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.680399 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.680705 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.681006 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.681302 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.681662 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.682036 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.682239 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.682955 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.682955 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.683270 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.683436 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.683698 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.684008 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.684292 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.684601 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.684916 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.685222 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.685522 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.685863 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.686161 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.686430 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 14:02:41.687069 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.687245 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 14:02:41.687393 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.687393 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.687766 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 14:02:41.687935 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.688233 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 14:02:41.688395 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.688547 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 14:02:41.689199 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.689370 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.689533 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.689736 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.690078 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.690078 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.690431 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.690576 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.690736 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.690892 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.691169 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.691332 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.691486 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.691647 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.691799 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.691952 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.692203 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.692364 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.692529 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.692529 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.692818 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.692972 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.693128 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.693272 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821824-1-iscsi {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.693431 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.693577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.693748 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.693898 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.694055 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.694206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.694472 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.694743 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.694899 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.695052 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.695207 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.695207 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.695494 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.695494 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.695776 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.695776 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.696073 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.696263 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.696423 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.696568 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.696717 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.696869 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.697042 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.697284 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.697433 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.697578 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.697756 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.697912 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.698064 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.698227 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.698384 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.698642 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.698792 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.698943 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.699271 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.699424 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.699577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.699731 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.699731 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.700188 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821824-1-iscsi {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.700358 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.700512 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.700668 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.700820 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.700982 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.701156 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.701394 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.701548 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.701733 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.701885 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.702029 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.702206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.702422 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.702577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.702722 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.702883 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.703027 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.703185 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.703330 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.703474 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.703713 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.703890 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.704055 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.704201 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.704351 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.704586 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.704766 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.705014 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.705187 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.705341 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.705498 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.705709 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.705859 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.706016 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.706172 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.706172 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.706172 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.706578 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.706730 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.706882 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.707036 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.707186 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.707431 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.707590 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.707742 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.707898 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.708049 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.708193 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.708335 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.708590 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.708756 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.708909 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.708909 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.709386 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.709386 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.709714 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.709870 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.710022 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.710186 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.710481 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.710627 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.710780 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.710938 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.711089 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.711241 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.711403 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.711546 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.711803 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.711962 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.712115 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.712259 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.712427 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.712656 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.712888 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.713042 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.713187 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.713336 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.713498 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.713693 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.713858 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.714004 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.714147 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.714304 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.714448 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.714615 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.714838 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.715006 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.715253 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.715419 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.715564 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.715721 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.715879 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.716034 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.716178 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.716329 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.716480 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.716623 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.716776 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.716920 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.717079 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.717222 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.717364 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.717628 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.717808 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.717952 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.718106 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.718258 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.718402 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.718554 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.718706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.718859 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.719017 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.719162 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.719388 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.719694 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.719854 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.720011 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.720155 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.720298 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.720609 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.720763 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.720918 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.721069 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.721215 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.721367 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.721520 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.721692 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.722019 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.722189 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.722345 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.722500 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.722661 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.722888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.723045 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.723190 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.723334 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.723478 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.723621 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.723774 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.723774 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.724455 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.724455 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.724765 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.725003 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.725175 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.725445 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.725595 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.726420 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.726588 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.726742 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.726897 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.727042 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.727186 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.727336 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.727494 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.727739 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.727903 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.728057 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.728211 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.728364 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.728509 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.728662 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.728813 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.728966 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.729111 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.729268 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.729419 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.729757 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.729928 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.730075 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.730235 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.730380 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.730687 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.730837 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.730981 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.731132 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.731289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.731442 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.731593 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.731746 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.731910 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.732170 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.732337 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.732492 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.732649 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.732802 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.733035 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.733193 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.733346 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.733497 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.733713 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.733874 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.734019 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.734203 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.734357 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.734509 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.734653 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.734796 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.735005 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.735218 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.735367 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.735620 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.735770 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.735915 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.736082 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.736277 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.736430 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.736587 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.736731 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.737237 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.737394 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.737538 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.737728 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.737982 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:02:41.738140 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.738284 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.738503 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.738661 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.738825 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.738980 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.739136 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.739292 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.739444 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.739597 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.739925 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.740084 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.740368 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.740368 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.740957 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.741110 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.741276 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.741422 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.741573 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.741777 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.741937 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.742081 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.742340 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.742497 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.742641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.742809 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.743030 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.743265 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.743265 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.743554 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.743554 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.743845 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.743997 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.744155 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.744310 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.744469 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.744627 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.744794 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.744937 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.745080 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.745248 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.745468 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.745673 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.745917 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.745917 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.746203 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.746347 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.746498 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.746662 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.746807 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.746950 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.747095 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.747246 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.747404 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.747550 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.747710 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.747854 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.748101 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.748265 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.748423 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.748576 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.748728 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.748872 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.749015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.749166 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.749327 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.749481 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.749676 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.749970 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.750136 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.750281 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.750434 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.750648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.750951 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.751104 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.751259 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.751418 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.751562 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.751836 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.752011 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.752168 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.752338 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.752592 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.752752 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.752896 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.753150 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.753400 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.753556 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.753738 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.753738 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.754028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.754173 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.754324 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.754482 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.754641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.754641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.754641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.755050 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.755050 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.755050 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.755482 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.755706 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.755855 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.756119 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.756277 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.756441 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.756607 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.756760 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.756913 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.757064 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.757214 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.757367 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.757510 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.757723 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.757886 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.758038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.758273 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.758430 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.758585 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.758736 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.758736 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.759017 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.759017 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.759308 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.759452 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.759601 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.759752 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.759904 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.760210 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.760368 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.760520 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.760683 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.760683 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.761486 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.761673 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.761832 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.761979 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.762132 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.762295 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.762448 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.762627 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.762870 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.763034 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.763197 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.763393 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.763626 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.763789 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.763941 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.764099 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.764266 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.764417 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.764575 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.764725 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.764875 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.765024 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.765187 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.765340 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.765501 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.765689 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.765930 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.766135 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.766405 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.766561 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.766720 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.766875 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.767026 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.767189 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.767349 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.767500 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.767663 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.767820 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.767979 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.768142 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.768326 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.768563 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.768720 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.768870 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.769030 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.769265 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.769426 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.769578 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.769779 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.769954 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.770501 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.770668 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.770819 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.770970 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.771216 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.771381 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.772030 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.772192 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.772351 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.772508 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.772508 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.772508 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.772508 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.772508 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.772508 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.772508 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.772508 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.774522 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.774522 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.774522 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.774522 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.774522 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.774522 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.774522 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.774522 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.775697 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.775697 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.775697 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.775697 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.776442 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.776706 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.776874 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.777654 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.777818 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.777984 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.778136 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.778288 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.778451 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.778702 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.778861 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.779022 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.779022 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.779310 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.779469 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.779620 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.779779 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.779945 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.780107 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.780285 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.780603 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.780766 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.780927 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.781088 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.781255 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.781492 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.781893 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.782165 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.782337 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.782497 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.782658 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.782658 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.782658 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.782658 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.782658 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.782658 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.782658 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.782658 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.783926 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.783926 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.783926 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.783926 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.783926 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.783926 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.783926 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.783926 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.785210 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.785210 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.785503 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.785697 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.785868 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.786043 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.786288 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.786444 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.786594 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.786857 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.787015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.787176 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.787176 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.787485 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.787636 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.787797 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.787961 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.788131 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.788283 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.788434 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.788583 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.788818 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.789003 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.789175 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.789475 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.789717 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.789889 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.790040 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.790199 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.790350 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.790667 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.790833 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.790992 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.791152 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.791315 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.791493 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.791720 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.791885 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.792036 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.792278 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.792444 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.792597 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.792755 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.792913 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.793064 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.793213 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.793397 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.793655 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.793825 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.793985 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.794215 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.794394 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.794633 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.794799 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.794950 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.795108 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.795271 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.795436 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.795588 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.795745 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.795903 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.796071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.796228 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.796480 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.796655 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.796808 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.797065 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.797229 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.797425 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.798321 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.798505 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.798659 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.798839 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.799071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.799242 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.799402 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.799560 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.799731 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.799890 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.800041 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.800201 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.801118 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.801365 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.801521 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.801707 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.801937 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.802105 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.802626 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.802827 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.802993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.803145 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.803296 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.803453 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.803630 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.803897 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.804054 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.804205 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.804363 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.804515 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.804771 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.805030 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.805200 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.805353 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.805504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.805700 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.805859 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.806032 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.806186 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.806345 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.806591 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.806749 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.806914 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.807085 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.807358 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.807514 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.807824 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.807977 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.808138 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.808292 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.808449 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.808599 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.808750 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.808917 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.809385 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.809555 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.809732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.809896 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.810047 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.810215 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.810375 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.810535 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.810686 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.811017 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.811178 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.811178 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.811483 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.811641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.811792 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.811960 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.811960 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.812355 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.812509 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.812756 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.812925 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.813153 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.813307 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.813475 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.813646 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.813958 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.814405 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.814676 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.814676 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.815098 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.815261 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.815404 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.815734 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.815889 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.816062 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.816218 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.816313 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.816459 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.816579 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.816722 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.816822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.816904 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.816983 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.817122 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.817212 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.817305 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.817417 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.817504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.817596 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.817708 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.817794 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.817895 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.817981 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.818222 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.818316 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.818401 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.818492 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.818590 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.818675 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.818760 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.818850 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.818939 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.819022 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.819114 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.819273 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.819369 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.819461 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.819546 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.819635 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.819635 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.819798 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.819882 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.819971 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.820065 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.820401 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.820539 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.820652 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.820789 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.820888 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.820888 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.821230 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.821230 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.821416 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.821502 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.821600 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.821600 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.821778 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.821863 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.821946 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.822029 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.822218 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.822218 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.822432 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.822528 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.822622 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.822739 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.822881 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.822970 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.823071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.823155 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.823254 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.823348 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.823448 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.823544 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.823633 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.823717 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.823800 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.823891 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.824051 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.824154 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.824247 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.824333 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.824427 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.824512 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.824594 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.824692 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.824788 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.824879 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.825001 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.825095 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.825195 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.825287 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.825374 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.825457 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.825556 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.825696 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.825792 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.825884 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.825973 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.826065 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.826163 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.826252 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.826336 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.826426 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.826512 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.826611 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.826705 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.826798 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.826881 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.826977 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.827063 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.827156 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.827156 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.827318 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.827413 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.827497 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.827580 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.827676 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.827768 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.827852 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.827852 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.828011 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.828103 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.828280 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.828362 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.828443 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.828521 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.828785 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.828897 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.828993 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.829078 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.829172 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.829264 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.829351 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.829439 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.829519 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.829731 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.829845 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.829932 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.830017 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.830110 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.830195 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.830279 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.830362 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.830444 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.830528 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.830619 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.830715 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.830799 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.830893 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.830977 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.831049 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.831174 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.831262 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.831342 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.831419 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.831510 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.831613 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.831707 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.831707 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.831853 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.831933 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.832012 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.832091 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.832163 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.832241 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.832312 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.832389 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.832466 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.832550 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.832629 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.832707 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.832785 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.832856 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.832934 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.833007 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.833077 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.833147 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.833224 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.833303 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.833387 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.833459 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.833528 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.833597 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.833825 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.833903 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.833993 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.834076 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.834156 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.834227 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.834311 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.834390 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.834461 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.834539 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.834609 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.834687 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.834766 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.834837 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.834913 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.834986 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.835055 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.835055 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.835194 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.835264 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.835343 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.835343 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.835343 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.835343 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.835612 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.835683 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.835752 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.835822 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.835891 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.835969 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.836047 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.836126 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.836205 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.836325 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.836405 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.836487 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.836559 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.836636 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.836716 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.836787 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.836866 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.836945 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.837018 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.837018 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.837018 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.837211 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.837360 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.837442 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.837859 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.838018 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.838121 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.838208 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.838353 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.838511 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.838659 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.838826 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.838988 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.839159 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.839311 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.839484 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.839629 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.839869 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.839977 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.840079 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.840242 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.840400 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.840572 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.840732 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.840892 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.841013 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.841210 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.841303 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.841522 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.842617 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.842790 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.842992 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.843117 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.843238 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.843395 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.843495 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.843591 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.843716 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.843936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.844056 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.844175 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.844393 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.844523 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.844637 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.844748 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.844841 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.844936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.845029 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.845199 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.845397 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.845489 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.845795 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.845897 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.846064 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.846175 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.846383 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.846481 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.846693 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.846786 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.847012 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.847105 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.847317 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.847451 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.847622 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.847721 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.847938 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.848031 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.848247 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.848347 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.848552 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.848653 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.848856 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.848949 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.849173 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.849266 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.849480 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.849572 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.849818 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.849935 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.850128 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.850232 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.850437 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.850542 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.850749 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.850841 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.851053 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.851145 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.851356 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.851457 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.851654 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.851755 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.851964 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.852073 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.852275 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.852377 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.852579 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.852670 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.852880 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.853083 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.853177 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.853408 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.853509 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.853789 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.853904 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.854104 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.854220 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.854405 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.854498 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.854713 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.854805 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.855015 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.855121 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.855323 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.855425 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.855624 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.855719 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.855943 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.856045 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.856244 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.856344 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.856551 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.856653 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.856884 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.856994 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.857194 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.857399 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.857585 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.857700 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.857870 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.857976 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.858179 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.858279 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.858507 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.858599 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.858822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.858921 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.859229 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.859363 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.859541 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.859762 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.860045 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.860183 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.860303 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.860451 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.860579 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.860790 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.860900 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.861100 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.861195 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.861405 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.861505 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.861733 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.862158 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.862372 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.862470 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.862677 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.862769 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.862984 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.863095 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.863290 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.863392 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.863596 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.863687 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.863901 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.864001 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.864203 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.864297 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.864507 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.864612 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.864823 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.864924 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.865130 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.865224 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.865444 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.865550 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.865801 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.865895 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.866122 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.866222 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.866431 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.866630 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.866732 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.866819 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.867046 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.867148 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.867349 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.867485 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.867693 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.867797 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.867951 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.868045 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.868257 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.868358 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.868572 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.868698 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.868895 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.868986 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.869211 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.869302 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.869511 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.869656 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.869860 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.869972 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.870191 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.870286 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.870519 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.870621 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.870835 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.870935 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.871153 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.871247 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.871477 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.871584 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.871782 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.871920 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.872085 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.872187 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.872394 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.872495 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.872700 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.872806 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.873004 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.873096 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.873306 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.873399 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.873631 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.873728 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.873942 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.874043 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.874245 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.874338 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.874553 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.874647 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.874861 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.874952 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.875182 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.875275 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.875571 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.875676 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.875888 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.875981 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.876193 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.876298 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.876489 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.876584 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.876791 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.876891 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.877134 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.877245 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.877441 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.877535 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.877799 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.877960 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.878120 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.878238 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.878428 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.878530 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.878735 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.878828 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.879050 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.879156 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.879369 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.879476 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.879681 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.879798 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.880005 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.880115 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.880293 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.880397 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.880599 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.880693 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.880911 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.881078 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.881218 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.881366 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.881523 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.881686 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.881864 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.881955 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.882148 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.882258 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.882462 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.882555 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.882781 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.882877 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.883091 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.883344 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.883446 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.883678 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.883781 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.883999 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.884092 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.884310 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.884410 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.884618 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.884724 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.884927 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.885028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.885239 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.885340 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.885548 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.885674 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.885892 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.885993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.886217 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.886308 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.886531 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.886625 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.886849 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.886947 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.887174 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.887288 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.887497 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.887590 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.887967 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.888088 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.888188 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.888295 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.888445 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.888569 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.888751 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.888871 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.889061 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.889179 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.889303 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 14:02:41.889420 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.889731 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.890144 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.890366 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.890686 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.891070 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.891349 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.891715 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.892066 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.892382 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.892694 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.893005 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.893316 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.893644 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.893969 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.894302 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.894623 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.895010 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.895336 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.895654 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.896186 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.896498 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.896837 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.897162 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.897483 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.897822 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.898146 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.898452 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.898755 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.899058 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.899368 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.899675 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.899980 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.900300 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.900608 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.900910 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.901232 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.901540 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.902092 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.902443 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.902757 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.903081 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.903406 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.903722 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.904030 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.904356 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.904664 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.904971 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.905292 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.905600 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.905924 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.906227 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.906537 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.906887 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.907194 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.908322 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.908322 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.908797 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.908923 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.909160 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.909458 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.909793 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.910100 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.910410 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.910706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.911010 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.911318 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.911622 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.911928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.912234 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.912477 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_db.sqlalchemy.engines [None req-d8a70bb5-d70c-41f8-9108-50e401b37875 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:02:41.912611 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.912834 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.913140 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.914862 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.914862 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.914862 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.914862 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.914862 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.915290 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.915290 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.915577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.917210 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.917210 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.917210 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.917210 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.917810 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.917908 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.918173 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.918511 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.918824 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.919133 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.919440 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.919762 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.920073 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.920384 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.920694 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.921003 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.921313 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.921718 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.921945 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.922255 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.922771 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.923183 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.923525 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.923846 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.924164 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.924480 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.924799 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.925115 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.925424 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.925756 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.926070 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.926388 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.926717 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.927032 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.927335 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.927760 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.928074 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.928394 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.928716 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.929024 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.929344 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.929693 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.930006 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.930326 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.930635 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.930964 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.931300 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.931624 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.931944 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.932295 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.932555 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.932857 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.933163 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.933491 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.933844 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.934159 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.934479 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.934790 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.935119 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.935424 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.935744 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.936065 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.936379 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.936689 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.937020 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.937328 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.937657 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.938001 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.938415 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.938730 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.939040 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.939367 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.939692 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.939997 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.940323 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.940700 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.940953 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.941270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.941582 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.941931 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.942250 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.942625 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.942868 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.943178 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.943494 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.943807 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.944129 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.944453 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.944776 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.945107 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.945448 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.945785 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.946126 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.946451 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.946761 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.947071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.947374 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:02:41.947614 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 14:02:41.970332 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_db.sqlalchemy.engines [None req-1d5749af-40ae-4d1a-bcda-7b418e76bda1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:02:41.977961 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.context [None req-d8a70bb5-d70c-41f8-9108-50e401b37875 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff103318-e65e-4db9-8afc-ec27a2dfc0ea(cell1) {{(pid=116103) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 14:02:41.982655 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8a70bb5-d70c-41f8-9108-50e401b37875 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:02:41.984305 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8a70bb5-d70c-41f8-9108-50e401b37875 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:02:41.985396 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8a70bb5-d70c-41f8-9108-50e401b37875 None None] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:02:41.987813 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8a70bb5-d70c-41f8-9108-50e401b37875 None None] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:02:42.001264 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_db.sqlalchemy.engines [None req-d8a70bb5-d70c-41f8-9108-50e401b37875 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:02:42.003019 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_db.sqlalchemy.engines [None req-d8a70bb5-d70c-41f8-9108-50e401b37875 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:02:42.037170 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.context [None req-1d5749af-40ae-4d1a-bcda-7b418e76bda1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff103318-e65e-4db9-8afc-ec27a2dfc0ea(cell1) {{(pid=116104) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 14:02:42.041488 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d5749af-40ae-4d1a-bcda-7b418e76bda1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:02:42.043105 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d5749af-40ae-4d1a-bcda-7b418e76bda1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:02:42.043924 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d5749af-40ae-4d1a-bcda-7b418e76bda1 None None] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:02:42.045901 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d5749af-40ae-4d1a-bcda-7b418e76bda1 None None] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:02:42.060998 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_db.sqlalchemy.engines [None req-1d5749af-40ae-4d1a-bcda-7b418e76bda1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:02:42.062454 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_db.sqlalchemy.engines [None req-1d5749af-40ae-4d1a-bcda-7b418e76bda1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:02:42.176265 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_db.sqlalchemy.engines [None req-d8a70bb5-d70c-41f8-9108-50e401b37875 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:02:42.220436 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_db.sqlalchemy.engines [None req-1d5749af-40ae-4d1a-bcda-7b418e76bda1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:02:42.503832 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: WARNING keystonemiddleware.auth_token [None req-d8a70bb5-d70c-41f8-9108-50e401b37875 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 14:02:42.511382 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: WARNING keystonemiddleware.auth_token [None req-d8a70bb5-d70c-41f8-9108-50e401b37875 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 14:02:42.545917 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: WARNING keystonemiddleware.auth_token [None req-1d5749af-40ae-4d1a-bcda-7b418e76bda1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 14:02:42.553081 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: WARNING keystonemiddleware.auth_token [None req-1d5749af-40ae-4d1a-bcda-7b418e76bda1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 14:02:42.863175 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: WARNING keystonemiddleware.auth_token [None req-d8a70bb5-d70c-41f8-9108-50e401b37875 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 14:02:42.868416 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: WARNING keystonemiddleware.auth_token [None req-d8a70bb5-d70c-41f8-9108-50e401b37875 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 14:02:42.873812 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ed8d4e79c0 pid: 116103 (default app) Dec 15 14:02:42.894178 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: WARNING keystonemiddleware.auth_token [None req-1d5749af-40ae-4d1a-bcda-7b418e76bda1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 14:02:42.899381 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: WARNING keystonemiddleware.auth_token [None req-1d5749af-40ae-4d1a-bcda-7b418e76bda1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 14:02:42.905341 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ed8d4e79c0 pid: 116104 (default app) Dec 15 14:03:18.126137 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-45f01323-7525-4f8e-a32c-7ff906cd8d8c tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Action: 'create', calling method: .version_select at 0x7faa3e5d2e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-869953365"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:03:20.173213 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b23b9445-b934-4c1a-8101-b78f95f3b7ef tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1200056026", "imageRef": "9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7", "flavorRef": "452", "networks": [{"uuid": "e70f4198-8de0-4624-a450-a54d2c9cd52a"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:03:20.711283 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-b23b9445-b934-4c1a-8101-b78f95f3b7ef tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] validate_networks() for [('e70f4198-8de0-4624-a450-a54d2c9cd52a', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:03:20.750029 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-45f01323-7525-4f8e-a32c-7ff906cd8d8c tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.761304 Dec 15 14:03:20.750991 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1154 bytes} [Wed Dec 15 14:03:16 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 3766 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 14:03:20.777058 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fea1a8c6-ba55-413d-b4ae-0a8c25af0dc0 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3e4a59d0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:20.924289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fea1a8c6-ba55-413d-b4ae-0a8c25af0dc0 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/266b8da6-cd10-4f9d-95ba-2d73e3594217" status: 200 len: 344 microversion: 2.1 time: 0.163548 Dec 15 14:03:20.924968 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 2/2] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:03:20 2021] GET /compute/v2.1/os-volumes/266b8da6-cd10-4f9d-95ba-2d73e3594217 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:21.938378 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-38ad8398-6423-4680-87bf-06a14a11fd2f tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3e4a5dc0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:22.002214 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-38ad8398-6423-4680-87bf-06a14a11fd2f tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/266b8da6-cd10-4f9d-95ba-2d73e3594217" status: 200 len: 345 microversion: 2.1 time: 0.068783 Dec 15 14:03:22.002740 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 3/3] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:03:21 2021] GET /compute/v2.1/os-volumes/266b8da6-cd10-4f9d-95ba-2d73e3594217 => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:03:22.014438 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dd28fc05-bd18-4d39-8b64-c48a6ded8a49 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Action: 'create', calling method: .version_select at 0x7faa3e4b63a0>, body: {"snapshot": {"volume_id": "266b8da6-cd10-4f9d-95ba-2d73e3594217", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-260737004"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:03:22.271144 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dd28fc05-bd18-4d39-8b64-c48a6ded8a49 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.257356 Dec 15 14:03:22.272904 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 4/4] 10.222.0.42 () {60 vars in 1161 bytes} [Wed Dec 15 14:03:22 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:22.282576 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-311b228b-617d-47d1-9850-e4cbcecf35f4 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3e4b6f70>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:22.379175 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-311b228b-617d-47d1-9850-e4cbcecf35f4 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d" status: 200 len: 286 microversion: 2.1 time: 0.100761 Dec 15 14:03:22.380289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 5/5] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Dec 15 14:03:22 2021] GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d => generated 286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:22.385676 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-b23b9445-b934-4c1a-8101-b78f95f3b7ef tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:03:22.386282 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-b23b9445-b934-4c1a-8101-b78f95f3b7ef tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:03:22.386557 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-b23b9445-b934-4c1a-8101-b78f95f3b7ef tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:03:22.387005 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-b23b9445-b934-4c1a-8101-b78f95f3b7ef tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:03:22.387429 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-b23b9445-b934-4c1a-8101-b78f95f3b7ef tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:03:22.394986 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-52359aaa-d74f-4db6-b6c4-f40e4abc481c tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3e4b6ee0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:22.440501 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b23b9445-b934-4c1a-8101-b78f95f3b7ef tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:22.441328 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b23b9445-b934-4c1a-8101-b78f95f3b7ef tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:22.444242 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b23b9445-b934-4c1a-8101-b78f95f3b7ef tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:22.445558 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b23b9445-b934-4c1a-8101-b78f95f3b7ef tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:22.505163 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-b23b9445-b934-4c1a-8101-b78f95f3b7ef tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Getting quotas for project e6983fc3490f4adca748ac8a66d65c33. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:03:22.506932 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-52359aaa-d74f-4db6-b6c4-f40e4abc481c tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.115494 Dec 15 14:03:22.508875 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 6/6] 10.222.0.42 () {58 vars in 1139 bytes} [Wed Dec 15 14:03:22 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:22.520693 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2c5f63e3-4261-4cc9-bd3d-78b9337f530f tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3e4a5ee0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:22.530938 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-b23b9445-b934-4c1a-8101-b78f95f3b7ef tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Getting quotas for user 6c30e805583648f1a7580b8c378163aa and project e6983fc3490f4adca748ac8a66d65c33. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:03:22.566572 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b23b9445-b934-4c1a-8101-b78f95f3b7ef tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:03:22.575328 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2c5f63e3-4261-4cc9-bd3d-78b9337f530f tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d" status: 200 len: 286 microversion: 2.1 time: 0.060964 Dec 15 14:03:22.576207 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 7/7] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Dec 15 14:03:22 2021] GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:22.580643 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b23b9445-b934-4c1a-8101-b78f95f3b7ef tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:03:22.783274 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b23b9445-b934-4c1a-8101-b78f95f3b7ef tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.209771 Dec 15 14:03:22.799422 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1/8] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Dec 15 14:03:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 3228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 14:03:22.799693 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ed1a07a3-e3bc-484e-be8a-bc7d031410f1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:22.800654 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ed1a07a3-e3bc-484e-be8a-bc7d031410f1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:23.228009 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ed1a07a3-e3bc-484e-be8a-bc7d031410f1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:23.254920 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ed1a07a3-e3bc-484e-be8a-bc7d031410f1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1215 microversion: 2.1 time: 0.464743 Dec 15 14:03:23.255743 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 8/9] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:22 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1215 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:23.588494 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8dff7eca-bff7-4b87-8836-64f2869815ba tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3dbd1790>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:23.732990 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8dff7eca-bff7-4b87-8836-64f2869815ba tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d" status: 200 len: 286 microversion: 2.1 time: 0.148807 Dec 15 14:03:23.734161 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 2/10] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Dec 15 14:03:23 2021] GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d => generated 286 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:24.276778 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-aab6fbcd-8cfd-46df-a6da-dbfd2cbda95e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:24.278203 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-aab6fbcd-8cfd-46df-a6da-dbfd2cbda95e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:24.483729 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-aab6fbcd-8cfd-46df-a6da-dbfd2cbda95e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:24.497622 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-aab6fbcd-8cfd-46df-a6da-dbfd2cbda95e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1215 microversion: 2.1 time: 0.228955 Dec 15 14:03:24.506464 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 9/11] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:24 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1215 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:24.746633 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-24a96a00-15e2-4349-bb94-6a874c28e87d tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3dbee550>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:24.806244 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-24a96a00-15e2-4349-bb94-6a874c28e87d tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d" status: 200 len: 286 microversion: 2.1 time: 0.064151 Dec 15 14:03:24.806939 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 3/12] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Dec 15 14:03:24 2021] GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:25.522381 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-aa878f2a-55de-40c3-bbd6-376bb55ffbbf tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:25.523623 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-aa878f2a-55de-40c3-bbd6-376bb55ffbbf tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:25.537487 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa878f2a-55de-40c3-bbd6-376bb55ffbbf tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:25.541286 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa878f2a-55de-40c3-bbd6-376bb55ffbbf tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:25.543770 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa878f2a-55de-40c3-bbd6-376bb55ffbbf tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:25.547517 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa878f2a-55de-40c3-bbd6-376bb55ffbbf tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:25.819263 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0e55eade-dca0-4e9f-b4f1-63a4cb7a7d54 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3d341dc0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:25.908460 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0e55eade-dca0-4e9f-b4f1-63a4cb7a7d54 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d" status: 200 len: 286 microversion: 2.1 time: 0.093657 Dec 15 14:03:25.909281 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 4/13] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Dec 15 14:03:25 2021] GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:03:26.085864 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-aa878f2a-55de-40c3-bbd6-376bb55ffbbf tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:26.111812 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-aa878f2a-55de-40c3-bbd6-376bb55ffbbf tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1219 microversion: 2.1 time: 0.595843 Dec 15 14:03:26.114472 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 10/14] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:25 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1219 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:26.920056 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8cb295ce-7739-404a-be12-8286a05ba267 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3d341e50>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:26.992513 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8cb295ce-7739-404a-be12-8286a05ba267 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d" status: 200 len: 286 microversion: 2.1 time: 0.076022 Dec 15 14:03:26.993100 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 5/15] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Dec 15 14:03:26 2021] GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:27.129587 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-56d7eac3-6abc-438f-8b61-3c947728db75 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:27.130260 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-56d7eac3-6abc-438f-8b61-3c947728db75 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:27.143675 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56d7eac3-6abc-438f-8b61-3c947728db75 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:27.144146 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56d7eac3-6abc-438f-8b61-3c947728db75 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:27.144987 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56d7eac3-6abc-438f-8b61-3c947728db75 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:27.145917 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56d7eac3-6abc-438f-8b61-3c947728db75 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:27.307395 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-56d7eac3-6abc-438f-8b61-3c947728db75 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:27.321251 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-56d7eac3-6abc-438f-8b61-3c947728db75 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1211 microversion: 2.1 time: 0.195162 Dec 15 14:03:27.323192 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 11/16] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:27 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1211 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:28.006363 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-529bdad7-3cbf-48ea-9248-e2c73287c6d2 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3dbee550>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:28.098252 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-529bdad7-3cbf-48ea-9248-e2c73287c6d2 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d" status: 200 len: 287 microversion: 2.1 time: 0.095736 Dec 15 14:03:28.099227 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 6/17] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Dec 15 14:03:28 2021] GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:28.117266 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-273413b0-f956-4e11-8c40-f71e8e69ba00 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3e3b0040>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:28.469827 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-273413b0-f956-4e11-8c40-f71e8e69ba00 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d" status: 202 len: 0 microversion: 2.1 time: 0.357595 Dec 15 14:03:28.471124 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 12/18] 10.222.0.42 () {58 vars in 1253 bytes} [Wed Dec 15 14:03:28 2021] DELETE /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:03:28.476594 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-323b3dff-9239-4981-8d2d-87980561fce0 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:28.477206 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-323b3dff-9239-4981-8d2d-87980561fce0 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:28.488334 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-323b3dff-9239-4981-8d2d-87980561fce0 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:28.488696 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-323b3dff-9239-4981-8d2d-87980561fce0 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:28.489496 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-323b3dff-9239-4981-8d2d-87980561fce0 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:28.489960 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-323b3dff-9239-4981-8d2d-87980561fce0 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:28.623451 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-323b3dff-9239-4981-8d2d-87980561fce0 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:28.634326 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-323b3dff-9239-4981-8d2d-87980561fce0 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1267 microversion: 2.1 time: 0.161790 Dec 15 14:03:28.634917 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 13/19] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:28 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:28.660829 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d104c9e1-0f0f-4fb7-96c4-3a21f8955857 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3e34d790>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:28.779837 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ede93408-f4e0-4d32-916f-63637be48492 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'create', calling method: .version_select at 0x7faa3d34a430>, body: {"keypair": {"name": "tempest-keypair-219756940"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:03:28.785059 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d104c9e1-0f0f-4fb7-96c4-3a21f8955857 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d" status: 200 len: 286 microversion: 2.1 time: 0.129933 Dec 15 14:03:28.785857 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 14/20] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Dec 15 14:03:28 2021] GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d => generated 286 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:28.840361 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-ede93408-f4e0-4d32-916f-63637be48492 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Getting quotas for project db115a6a96f249a88a86dc25569d6ebc. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:03:28.849664 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-ede93408-f4e0-4d32-916f-63637be48492 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Getting quotas for user 68c5d857247f4fbabae43f49d3644d2e and project db115a6a96f249a88a86dc25569d6ebc. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:03:29.135912 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-53b3c877-e3d0-4334-ac5e-5aae2f52c4fd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'create', calling method: .version_select at 0x7faa3e343430>, body: {"keypair": {"name": "tempest-keypair-46775383"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:03:29.247152 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-53b3c877-e3d0-4334-ac5e-5aae2f52c4fd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Getting quotas for project b5979590d3d84996a1c7bd99feffc601. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:03:29.269528 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-53b3c877-e3d0-4334-ac5e-5aae2f52c4fd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Getting quotas for user c39f58b934374c718793574870072027 and project b5979590d3d84996a1c7bd99feffc601. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:03:29.491797 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-ede93408-f4e0-4d32-916f-63637be48492 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Getting quotas for project db115a6a96f249a88a86dc25569d6ebc. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:03:29.498070 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-ede93408-f4e0-4d32-916f-63637be48492 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Getting quotas for user 68c5d857247f4fbabae43f49d3644d2e and project db115a6a96f249a88a86dc25569d6ebc. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:03:29.523435 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ede93408-f4e0-4d32-916f-63637be48492 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.312872 Dec 15 14:03:29.524861 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 7/21] 10.222.0.42 () {60 vars in 1157 bytes} [Wed Dec 15 14:03:28 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:03:29.551513 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-53b3c877-e3d0-4334-ac5e-5aae2f52c4fd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Getting quotas for project b5979590d3d84996a1c7bd99feffc601. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:03:29.556278 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-53b3c877-e3d0-4334-ac5e-5aae2f52c4fd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Getting quotas for user c39f58b934374c718793574870072027 and project b5979590d3d84996a1c7bd99feffc601. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:03:29.571408 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-53b3c877-e3d0-4334-ac5e-5aae2f52c4fd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 2318 microversion: 2.20 time: 0.616420 Dec 15 14:03:29.579035 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 15/22] 10.222.0.42 () {62 vars in 1198 bytes} [Wed Dec 15 14:03:28 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 625 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 15 14:03:29.662880 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2f0df3aa-48e5-4c72-804a-51cfb5dd7e51 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:29.663510 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2f0df3aa-48e5-4c72-804a-51cfb5dd7e51 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:29.689450 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f0df3aa-48e5-4c72-804a-51cfb5dd7e51 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:29.689936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f0df3aa-48e5-4c72-804a-51cfb5dd7e51 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:29.694134 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f0df3aa-48e5-4c72-804a-51cfb5dd7e51 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:29.695354 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f0df3aa-48e5-4c72-804a-51cfb5dd7e51 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:29.923489 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2f0df3aa-48e5-4c72-804a-51cfb5dd7e51 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:29.927716 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f59c9731-4e49-4361-a1d5-16f593c66e3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1653462934", "imageRef": "9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aeddf409-5409-49dd-a0f3-0498ed720208"}]}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:03:29.949994 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2f0df3aa-48e5-4c72-804a-51cfb5dd7e51 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1267 microversion: 2.1 time: 0.291931 Dec 15 14:03:29.950818 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 8/23] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:29 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1267 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:29.964952 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cabebd28-26e7-4a7a-a068-e33f95029ffb tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3ca8faf0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:30.006554 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cabebd28-26e7-4a7a-a068-e33f95029ffb tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d" status: 200 len: 286 microversion: 2.1 time: 0.046541 Dec 15 14:03:30.007132 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 9/24] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Dec 15 14:03:29 2021] GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:30.034010 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-f59c9731-4e49-4361-a1d5-16f593c66e3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] validate_networks() for [('aeddf409-5409-49dd-a0f3-0498ed720208', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:03:30.767750 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-f59c9731-4e49-4361-a1d5-16f593c66e3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:03:30.768236 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-f59c9731-4e49-4361-a1d5-16f593c66e3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:03:30.768723 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-f59c9731-4e49-4361-a1d5-16f593c66e3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:03:30.769132 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-f59c9731-4e49-4361-a1d5-16f593c66e3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:03:30.769541 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-f59c9731-4e49-4361-a1d5-16f593c66e3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:03:30.782587 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f59c9731-4e49-4361-a1d5-16f593c66e3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:30.783063 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f59c9731-4e49-4361-a1d5-16f593c66e3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:30.784051 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f59c9731-4e49-4361-a1d5-16f593c66e3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:30.784528 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f59c9731-4e49-4361-a1d5-16f593c66e3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:30.825542 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-f59c9731-4e49-4361-a1d5-16f593c66e3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Getting quotas for project e0e7e4ff045841da83496eb91b777892. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:03:30.830781 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-f59c9731-4e49-4361-a1d5-16f593c66e3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Getting quotas for user af34616c9f1f4517b912ea241d1388e6 and project e0e7e4ff045841da83496eb91b777892. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:03:30.844897 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f59c9731-4e49-4361-a1d5-16f593c66e3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:03:30.857531 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f59c9731-4e49-4361-a1d5-16f593c66e3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:03:30.967665 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0536a479-ee37-4b4c-95ae-662e0f993e1d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:30.968440 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0536a479-ee37-4b4c-95ae-662e0f993e1d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:30.978016 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0536a479-ee37-4b4c-95ae-662e0f993e1d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:30.978510 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0536a479-ee37-4b4c-95ae-662e0f993e1d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:30.980013 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0536a479-ee37-4b4c-95ae-662e0f993e1d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:30.980581 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0536a479-ee37-4b4c-95ae-662e0f993e1d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:31.005133 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f59c9731-4e49-4361-a1d5-16f593c66e3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.230639 Dec 15 14:03:31.006710 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 16/25] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Dec 15 14:03:29 2021] POST /compute/v2.1/servers => generated 383 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:03:31.019332 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0cb7a012-7456-4e4f-995d-9f3926266ec3 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:31.020414 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0cb7a012-7456-4e4f-995d-9f3926266ec3 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:31.136171 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0536a479-ee37-4b4c-95ae-662e0f993e1d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:31.147375 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0536a479-ee37-4b4c-95ae-662e0f993e1d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1267 microversion: 2.1 time: 0.184591 Dec 15 14:03:31.150363 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 10/26] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:30 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:31.155851 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0cb7a012-7456-4e4f-995d-9f3926266ec3 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:31.163333 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0cb7a012-7456-4e4f-995d-9f3926266ec3 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1222 microversion: 2.1 time: 0.149621 Dec 15 14:03:31.163505 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-879e6478-d731-465a-bbe3-cad3a714980f tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3ca478b0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:31.178269 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 17/27] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:31 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1222 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:31.208307 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-879e6478-d731-465a-bbe3-cad3a714980f tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d" status: 200 len: 286 microversion: 2.1 time: 0.056676 Dec 15 14:03:31.209377 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 11/28] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Dec 15 14:03:31 2021] GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:31.297337 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7fe18150-393d-4b3f-9b20-9dc68282c0f9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-985013796", "imageRef": "9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aeddf409-5409-49dd-a0f3-0498ed720208"}]}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:03:31.406156 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-7fe18150-393d-4b3f-9b20-9dc68282c0f9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] validate_networks() for [('aeddf409-5409-49dd-a0f3-0498ed720208', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:03:32.167699 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9f9dfcc1-dc63-472c-85d2-85628002c450 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:32.168382 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9f9dfcc1-dc63-472c-85d2-85628002c450 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:32.186700 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f9dfcc1-dc63-472c-85d2-85628002c450 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:32.187585 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f9dfcc1-dc63-472c-85d2-85628002c450 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:32.190701 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f9dfcc1-dc63-472c-85d2-85628002c450 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:32.191417 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f9dfcc1-dc63-472c-85d2-85628002c450 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:32.944274 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9f9dfcc1-dc63-472c-85d2-85628002c450 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:32.961952 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9f9dfcc1-dc63-472c-85d2-85628002c450 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1273 microversion: 2.1 time: 0.798287 Dec 15 14:03:32.962546 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 12/29] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:32 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1273 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:33.006214 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d25c6e2c-d389-4f65-ba82-a16e8d5b9ffc tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3ca4f430>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:33.056218 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-d25c6e2c-d389-4f65-ba82-a16e8d5b9ffc tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] HTTP exception thrown: Snapshot 496cb56f-fca0-4e96-b97d-eedfec42370d could not be found. Dec 15 14:03:33.057549 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d25c6e2c-d389-4f65-ba82-a16e8d5b9ffc tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Returning 404 to user: Snapshot 496cb56f-fca0-4e96-b97d-eedfec42370d could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:03:33.059843 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d25c6e2c-d389-4f65-ba82-a16e8d5b9ffc tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d" status: 404 len: 111 microversion: 2.1 time: 0.086466 Dec 15 14:03:33.063354 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 13/30] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Dec 15 14:03:32 2021] GET /compute/v2.1/os-snapshots/496cb56f-fca0-4e96-b97d-eedfec42370d => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:03:33.092005 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-27fdf1d1-e622-4c10-8f6d-002e9c662737 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3ee254c0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:33.281023 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-27fdf1d1-e622-4c10-8f6d-002e9c662737 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/266b8da6-cd10-4f9d-95ba-2d73e3594217" status: 202 len: 0 microversion: 2.1 time: 0.203066 Dec 15 14:03:33.281917 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 14/31] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Dec 15 14:03:33 2021] DELETE /compute/v2.1/os-volumes/266b8da6-cd10-4f9d-95ba-2d73e3594217 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:03:33.287382 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-194cf11b-6150-4a08-9176-0866f4b1103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-837800400", "imageRef": "9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e188c8ca-d22a-41f7-a1cb-0eaacf67cdea"}], "security_groups": [{"name": "tempest-securitygroup--1643186652"}], "key_name": "tempest-keypair-46775383", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:03:34.356584 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-194cf11b-6150-4a08-9176-0866f4b1103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] validate_networks() for [('e188c8ca-d22a-41f7-a1cb-0eaacf67cdea', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:03:34.412507 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-7fe18150-393d-4b3f-9b20-9dc68282c0f9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:03:34.412990 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-7fe18150-393d-4b3f-9b20-9dc68282c0f9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:03:34.413362 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-7fe18150-393d-4b3f-9b20-9dc68282c0f9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:03:34.413816 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-7fe18150-393d-4b3f-9b20-9dc68282c0f9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:03:34.414267 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-7fe18150-393d-4b3f-9b20-9dc68282c0f9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:03:34.425993 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fe18150-393d-4b3f-9b20-9dc68282c0f9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:34.426899 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fe18150-393d-4b3f-9b20-9dc68282c0f9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:34.428005 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fe18150-393d-4b3f-9b20-9dc68282c0f9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:34.428797 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fe18150-393d-4b3f-9b20-9dc68282c0f9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:34.449914 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-7fe18150-393d-4b3f-9b20-9dc68282c0f9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Getting quotas for project e0e7e4ff045841da83496eb91b777892. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:03:34.454958 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-7fe18150-393d-4b3f-9b20-9dc68282c0f9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Getting quotas for user af34616c9f1f4517b912ea241d1388e6 and project e0e7e4ff045841da83496eb91b777892. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:03:34.479699 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7fe18150-393d-4b3f-9b20-9dc68282c0f9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:03:34.482570 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7fe18150-393d-4b3f-9b20-9dc68282c0f9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:03:34.627697 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7fe18150-393d-4b3f-9b20-9dc68282c0f9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.335226 Dec 15 14:03:34.628977 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 18/32] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Dec 15 14:03:31 2021] POST /compute/v2.1/servers => generated 383 bytes in 3337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:03:34.633647 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-34a1d664-e149-4396-829f-dcd2339371e9 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3da4d8b0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:34.727249 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-34a1d664-e149-4396-829f-dcd2339371e9 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/266b8da6-cd10-4f9d-95ba-2d73e3594217" status: 200 len: 344 microversion: 2.1 time: 0.096995 Dec 15 14:03:34.727839 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 19/33] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:03:34 2021] GET /compute/v2.1/os-volumes/266b8da6-cd10-4f9d-95ba-2d73e3594217 => generated 344 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:34.732078 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ac9304f1-2bde-431e-9e84-45e592db9c7e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:34.732688 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ac9304f1-2bde-431e-9e84-45e592db9c7e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:34.745308 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac9304f1-2bde-431e-9e84-45e592db9c7e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:34.753831 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac9304f1-2bde-431e-9e84-45e592db9c7e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:34.754940 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac9304f1-2bde-431e-9e84-45e592db9c7e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:34.755525 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac9304f1-2bde-431e-9e84-45e592db9c7e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:34.938801 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ac9304f1-2bde-431e-9e84-45e592db9c7e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:34.946397 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ac9304f1-2bde-431e-9e84-45e592db9c7e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1273 microversion: 2.1 time: 0.217523 Dec 15 14:03:34.952941 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 20/34] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:34 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1273 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:34.957959 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d3e16afc-4fda-4a9d-822a-7eeacfaa4144 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:34.968406 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d3e16afc-4fda-4a9d-822a-7eeacfaa4144 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:35.277392 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d3e16afc-4fda-4a9d-822a-7eeacfaa4144 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:35.309846 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d3e16afc-4fda-4a9d-822a-7eeacfaa4144 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1221 microversion: 2.1 time: 0.355381 Dec 15 14:03:35.313961 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 21/35] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:34 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1221 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:35.742183 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4c433ce3-6234-4f0c-b07a-35d295bd99dd tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3c9fef70>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:35.861257 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4c433ce3-6234-4f0c-b07a-35d295bd99dd tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/266b8da6-cd10-4f9d-95ba-2d73e3594217" status: 200 len: 344 microversion: 2.1 time: 0.123831 Dec 15 14:03:35.862435 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 22/36] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:03:35 2021] GET /compute/v2.1/os-volumes/266b8da6-cd10-4f9d-95ba-2d73e3594217 => generated 344 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:35.976793 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0864666e-1f2e-42a7-adfd-f98874126f12 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:35.981659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0864666e-1f2e-42a7-adfd-f98874126f12 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:36.045292 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0864666e-1f2e-42a7-adfd-f98874126f12 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:36.047920 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0864666e-1f2e-42a7-adfd-f98874126f12 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:36.050227 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0864666e-1f2e-42a7-adfd-f98874126f12 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:36.054728 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0864666e-1f2e-42a7-adfd-f98874126f12 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:36.796081 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-194cf11b-6150-4a08-9176-0866f4b1103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:03:36.796921 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-194cf11b-6150-4a08-9176-0866f4b1103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:03:36.796921 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-194cf11b-6150-4a08-9176-0866f4b1103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:03:36.797283 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-194cf11b-6150-4a08-9176-0866f4b1103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:03:36.798255 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-194cf11b-6150-4a08-9176-0866f4b1103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:03:36.813027 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-194cf11b-6150-4a08-9176-0866f4b1103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:36.815407 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-194cf11b-6150-4a08-9176-0866f4b1103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:36.816286 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-194cf11b-6150-4a08-9176-0866f4b1103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:36.816724 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-194cf11b-6150-4a08-9176-0866f4b1103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:36.838033 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-194cf11b-6150-4a08-9176-0866f4b1103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Getting quotas for project b5979590d3d84996a1c7bd99feffc601. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:03:36.842872 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-194cf11b-6150-4a08-9176-0866f4b1103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Getting quotas for user c39f58b934374c718793574870072027 and project b5979590d3d84996a1c7bd99feffc601. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:03:36.869273 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-194cf11b-6150-4a08-9176-0866f4b1103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:03:36.872624 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-194cf11b-6150-4a08-9176-0866f4b1103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:03:36.946031 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-194cf11b-6150-4a08-9176-0866f4b1103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.659705 Dec 15 14:03:36.949824 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 15/37] 10.222.0.42 () {62 vars in 1187 bytes} [Wed Dec 15 14:03:33 2021] POST /compute/v2.1/servers => generated 402 bytes in 3666 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 14:03:36.955362 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a8a21eea-31cc-4ad7-89ca-96a67231efc6 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:36.960792 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a8a21eea-31cc-4ad7-89ca-96a67231efc6 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:36.980832 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a8a21eea-31cc-4ad7-89ca-96a67231efc6 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:36.981958 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a8a21eea-31cc-4ad7-89ca-96a67231efc6 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:36.983521 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a8a21eea-31cc-4ad7-89ca-96a67231efc6 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:36.986170 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a8a21eea-31cc-4ad7-89ca-96a67231efc6 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:37.116069 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a8a21eea-31cc-4ad7-89ca-96a67231efc6 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:37.129725 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a8a21eea-31cc-4ad7-89ca-96a67231efc6 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1225 microversion: 2.1 time: 0.177793 Dec 15 14:03:37.135194 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 16/38] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:36 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1225 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:37.149326 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-958c0b1b-0e1a-4684-a85f-8e5dd4aac95b tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3ca4f040>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:37.164707 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0864666e-1f2e-42a7-adfd-f98874126f12 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:37.181192 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0864666e-1f2e-42a7-adfd-f98874126f12 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 1.214875 Dec 15 14:03:37.207726 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 23/39] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:35 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:03:37.231357 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-90d49e92-7cfa-48e7-97b0-5838a11886c2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:37.232057 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-90d49e92-7cfa-48e7-97b0-5838a11886c2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:37.276883 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-958c0b1b-0e1a-4684-a85f-8e5dd4aac95b tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/266b8da6-cd10-4f9d-95ba-2d73e3594217" status: 200 len: 344 microversion: 2.1 time: 0.131087 Dec 15 14:03:37.277479 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 17/40] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:03:37 2021] GET /compute/v2.1/os-volumes/266b8da6-cd10-4f9d-95ba-2d73e3594217 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:37.380257 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90d49e92-7cfa-48e7-97b0-5838a11886c2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:37.387497 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90d49e92-7cfa-48e7-97b0-5838a11886c2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:37.393462 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90d49e92-7cfa-48e7-97b0-5838a11886c2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:37.397591 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-90d49e92-7cfa-48e7-97b0-5838a11886c2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1279 microversion: 2.20 time: 0.186466 Dec 15 14:03:37.399529 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 24/41] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:03:37 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1279 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:03:37.580299 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5286dde9-a3e2-4231-a964-26834b1ea7a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1548587175", "imageRef": "9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b346368-2300-48a0-8140-15a2e1ada590"}], "security_groups": [{"name": "tempest-securitygroup--117980602"}], "key_name": "tempest-keypair-219756940", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:03:37.794713 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-5286dde9-a3e2-4231-a964-26834b1ea7a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] validate_networks() for [('4b346368-2300-48a0-8140-15a2e1ada590', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:03:38.151812 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-36e1483d-c2bf-4711-9196-267f7687ba62 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:38.152434 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-36e1483d-c2bf-4711-9196-267f7687ba62 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:38.171585 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36e1483d-c2bf-4711-9196-267f7687ba62 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:38.178447 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36e1483d-c2bf-4711-9196-267f7687ba62 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:38.179573 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36e1483d-c2bf-4711-9196-267f7687ba62 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:38.180161 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36e1483d-c2bf-4711-9196-267f7687ba62 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:38.395590 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-36e1483d-c2bf-4711-9196-267f7687ba62 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:38.397159 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-5286dde9-a3e2-4231-a964-26834b1ea7a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:03:38.397815 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-5286dde9-a3e2-4231-a964-26834b1ea7a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:03:38.398084 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-5286dde9-a3e2-4231-a964-26834b1ea7a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:03:38.398487 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-5286dde9-a3e2-4231-a964-26834b1ea7a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:03:38.399046 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-5286dde9-a3e2-4231-a964-26834b1ea7a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:03:38.406937 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-36e1483d-c2bf-4711-9196-267f7687ba62 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1225 microversion: 2.1 time: 0.258564 Dec 15 14:03:38.409260 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5286dde9-a3e2-4231-a964-26834b1ea7a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:38.413749 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5286dde9-a3e2-4231-a964-26834b1ea7a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:38.413749 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5286dde9-a3e2-4231-a964-26834b1ea7a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:38.413749 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5286dde9-a3e2-4231-a964-26834b1ea7a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:38.416822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 25/42] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:38 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1225 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:38.427354 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c4679813-ff60-4556-b253-1db45cc428c5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:38.428540 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c4679813-ff60-4556-b253-1db45cc428c5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:38.457908 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4679813-ff60-4556-b253-1db45cc428c5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:38.459315 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4679813-ff60-4556-b253-1db45cc428c5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:38.460447 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4679813-ff60-4556-b253-1db45cc428c5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:38.461113 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4679813-ff60-4556-b253-1db45cc428c5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:38.470187 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-5286dde9-a3e2-4231-a964-26834b1ea7a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Getting quotas for project db115a6a96f249a88a86dc25569d6ebc. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:03:38.477075 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-5286dde9-a3e2-4231-a964-26834b1ea7a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Getting quotas for user 68c5d857247f4fbabae43f49d3644d2e and project db115a6a96f249a88a86dc25569d6ebc. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:03:38.497208 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5286dde9-a3e2-4231-a964-26834b1ea7a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:03:38.501285 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5286dde9-a3e2-4231-a964-26834b1ea7a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:03:38.573431 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5286dde9-a3e2-4231-a964-26834b1ea7a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.997945 Dec 15 14:03:38.588506 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 18/43] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Dec 15 14:03:37 2021] POST /compute/v2.1/servers => generated 401 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:03:38.593881 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-335c05ce-c0ad-4bd8-a7cb-ff81cf49270b tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3ca4fdc0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:38.749792 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-335c05ce-c0ad-4bd8-a7cb-ff81cf49270b tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/266b8da6-cd10-4f9d-95ba-2d73e3594217" status: 200 len: 344 microversion: 2.1 time: 0.159797 Dec 15 14:03:38.751629 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 19/44] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:03:38 2021] GET /compute/v2.1/os-volumes/266b8da6-cd10-4f9d-95ba-2d73e3594217 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:38.757370 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-89bb8dad-cec8-4708-8e7c-0028eec7971c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:38.758084 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-89bb8dad-cec8-4708-8e7c-0028eec7971c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:38.774184 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c4679813-ff60-4556-b253-1db45cc428c5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:38.779499 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-89bb8dad-cec8-4708-8e7c-0028eec7971c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:38.780183 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-89bb8dad-cec8-4708-8e7c-0028eec7971c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:38.781443 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-89bb8dad-cec8-4708-8e7c-0028eec7971c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:38.782059 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-89bb8dad-cec8-4708-8e7c-0028eec7971c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:38.802898 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c4679813-ff60-4556-b253-1db45cc428c5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.384527 Dec 15 14:03:38.803469 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 26/45] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:38 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:38.827887 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5be6fa01-e74a-4281-b0c9-8ea00dba695a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:38.829951 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5be6fa01-e74a-4281-b0c9-8ea00dba695a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:38.908178 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-89bb8dad-cec8-4708-8e7c-0028eec7971c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:38.923442 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-89bb8dad-cec8-4708-8e7c-0028eec7971c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:38.926697 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-89bb8dad-cec8-4708-8e7c-0028eec7971c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:38.928461 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-89bb8dad-cec8-4708-8e7c-0028eec7971c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1283 microversion: 2.20 time: 0.175385 Dec 15 14:03:38.929791 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 20/46] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:03:38 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1283 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:03:38.943874 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5be6fa01-e74a-4281-b0c9-8ea00dba695a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:38.950976 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5be6fa01-e74a-4281-b0c9-8ea00dba695a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1237 microversion: 2.1 time: 0.134606 Dec 15 14:03:38.952003 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 27/47] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:38 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1237 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:39.432441 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e1804eae-43ad-4be5-a8de-0902704d3d5b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:39.433135 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e1804eae-43ad-4be5-a8de-0902704d3d5b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:39.440316 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1804eae-43ad-4be5-a8de-0902704d3d5b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:39.441017 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1804eae-43ad-4be5-a8de-0902704d3d5b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:39.442021 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1804eae-43ad-4be5-a8de-0902704d3d5b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:39.442605 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1804eae-43ad-4be5-a8de-0902704d3d5b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:39.510655 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e1804eae-43ad-4be5-a8de-0902704d3d5b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:39.519760 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e1804eae-43ad-4be5-a8de-0902704d3d5b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1225 microversion: 2.1 time: 0.091149 Dec 15 14:03:39.520463 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 21/48] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:39 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:39.767371 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-74df6caa-f398-4abe-83bf-19a1bc7bfd8f tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3c9fed30>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:39.811881 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-74df6caa-f398-4abe-83bf-19a1bc7bfd8f tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] HTTP exception thrown: Volume 266b8da6-cd10-4f9d-95ba-2d73e3594217 could not be found. Dec 15 14:03:39.812698 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-74df6caa-f398-4abe-83bf-19a1bc7bfd8f tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Returning 404 to user: Volume 266b8da6-cd10-4f9d-95ba-2d73e3594217 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:03:39.813565 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-74df6caa-f398-4abe-83bf-19a1bc7bfd8f tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/266b8da6-cd10-4f9d-95ba-2d73e3594217" status: 404 len: 109 microversion: 2.1 time: 0.052357 Dec 15 14:03:39.823587 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 28/49] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:03:39 2021] GET /compute/v2.1/os-volumes/266b8da6-cd10-4f9d-95ba-2d73e3594217 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 14:03:39.829387 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-21241d6c-92dc-4a75-a88e-e53793483e12 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3da600d0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:39.832985 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fcc16757-6734-4ca6-b891-f08909f5e6f1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:39.837111 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fcc16757-6734-4ca6-b891-f08909f5e6f1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:39.867920 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fcc16757-6734-4ca6-b891-f08909f5e6f1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:39.869910 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-21241d6c-92dc-4a75-a88e-e53793483e12 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] HTTP exception thrown: Volume 266b8da6-cd10-4f9d-95ba-2d73e3594217 could not be found. Dec 15 14:03:39.870315 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fcc16757-6734-4ca6-b891-f08909f5e6f1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:39.871498 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-21241d6c-92dc-4a75-a88e-e53793483e12 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Returning 404 to user: Volume 266b8da6-cd10-4f9d-95ba-2d73e3594217 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:03:39.873565 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-21241d6c-92dc-4a75-a88e-e53793483e12 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/266b8da6-cd10-4f9d-95ba-2d73e3594217" status: 404 len: 109 microversion: 2.1 time: 0.048330 Dec 15 14:03:39.880274 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fcc16757-6734-4ca6-b891-f08909f5e6f1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:39.880611 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 29/50] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Dec 15 14:03:39 2021] DELETE /compute/v2.1/os-volumes/266b8da6-cd10-4f9d-95ba-2d73e3594217 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:03:39.884319 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fcc16757-6734-4ca6-b891-f08909f5e6f1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:39.891489 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7c499847-c1e9-4387-a67f-4659e740fc99 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Calling method '.version_select at 0x7faa3c9feaf0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:39.989684 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-7c499847-c1e9-4387-a67f-4659e740fc99 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] HTTP exception thrown: Volume 266b8da6-cd10-4f9d-95ba-2d73e3594217 could not be found. Dec 15 14:03:39.991756 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7c499847-c1e9-4387-a67f-4659e740fc99 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] Returning 404 to user: Volume 266b8da6-cd10-4f9d-95ba-2d73e3594217 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:03:39.992808 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7c499847-c1e9-4387-a67f-4659e740fc99 tempest-VolumesSnapshotsTestJSON-2105025024 tempest-VolumesSnapshotsTestJSON-2105025024-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/266b8da6-cd10-4f9d-95ba-2d73e3594217" status: 404 len: 109 microversion: 2.1 time: 0.110583 Dec 15 14:03:39.993560 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 30/51] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:03:39 2021] GET /compute/v2.1/os-volumes/266b8da6-cd10-4f9d-95ba-2d73e3594217 => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:03:40.002810 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-93e23596-5926-4548-9c93-ea68fd0d9d9f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:40.005653 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-93e23596-5926-4548-9c93-ea68fd0d9d9f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:40.014896 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93e23596-5926-4548-9c93-ea68fd0d9d9f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:40.015389 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93e23596-5926-4548-9c93-ea68fd0d9d9f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:40.016220 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93e23596-5926-4548-9c93-ea68fd0d9d9f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:40.016736 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93e23596-5926-4548-9c93-ea68fd0d9d9f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:40.138315 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-93e23596-5926-4548-9c93-ea68fd0d9d9f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:40.157099 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-93e23596-5926-4548-9c93-ea68fd0d9d9f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:40.160894 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-93e23596-5926-4548-9c93-ea68fd0d9d9f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:40.163432 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fcc16757-6734-4ca6-b891-f08909f5e6f1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:40.164689 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-93e23596-5926-4548-9c93-ea68fd0d9d9f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1283 microversion: 2.20 time: 0.166673 Dec 15 14:03:40.184459 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fcc16757-6734-4ca6-b891-f08909f5e6f1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.367503 Dec 15 14:03:40.188318 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 22/52] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:39 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:40.188611 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 31/53] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:03:39 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1283 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:03:40.203594 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-61f4627c-9abd-4f3b-831b-ee87f73df0ab tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:40.204340 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-61f4627c-9abd-4f3b-831b-ee87f73df0ab tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:40.214215 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61f4627c-9abd-4f3b-831b-ee87f73df0ab tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:40.214937 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61f4627c-9abd-4f3b-831b-ee87f73df0ab tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:40.216138 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61f4627c-9abd-4f3b-831b-ee87f73df0ab tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:40.216773 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61f4627c-9abd-4f3b-831b-ee87f73df0ab tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:40.433134 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-61f4627c-9abd-4f3b-831b-ee87f73df0ab tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:40.441826 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-61f4627c-9abd-4f3b-831b-ee87f73df0ab tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1241 microversion: 2.1 time: 0.252096 Dec 15 14:03:40.442429 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 23/54] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:40 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1241 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:40.537006 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c450ccdf-d0d9-4ba7-bfb0-00141165ca59 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:40.537732 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c450ccdf-d0d9-4ba7-bfb0-00141165ca59 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:40.560389 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c450ccdf-d0d9-4ba7-bfb0-00141165ca59 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:40.561549 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c450ccdf-d0d9-4ba7-bfb0-00141165ca59 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:40.566212 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c450ccdf-d0d9-4ba7-bfb0-00141165ca59 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:40.566984 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c450ccdf-d0d9-4ba7-bfb0-00141165ca59 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:40.725656 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c450ccdf-d0d9-4ba7-bfb0-00141165ca59 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:40.753589 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c450ccdf-d0d9-4ba7-bfb0-00141165ca59 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1225 microversion: 2.1 time: 0.220183 Dec 15 14:03:40.755667 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 32/55] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:40 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1225 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:41.185339 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-822bdf3d-fc5c-40ac-bad2-bf7c672858dd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:41.186370 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-822bdf3d-fc5c-40ac-bad2-bf7c672858dd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:41.206554 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fc2c813f-6e68-4b56-bbd2-57c2a8d4b5de tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:41.207772 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fc2c813f-6e68-4b56-bbd2-57c2a8d4b5de tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:41.219534 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-822bdf3d-fc5c-40ac-bad2-bf7c672858dd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:41.223906 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-822bdf3d-fc5c-40ac-bad2-bf7c672858dd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:41.226489 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-822bdf3d-fc5c-40ac-bad2-bf7c672858dd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:41.228149 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-822bdf3d-fc5c-40ac-bad2-bf7c672858dd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:41.228433 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc2c813f-6e68-4b56-bbd2-57c2a8d4b5de tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:41.229682 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc2c813f-6e68-4b56-bbd2-57c2a8d4b5de tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:41.235968 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc2c813f-6e68-4b56-bbd2-57c2a8d4b5de tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:41.237145 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc2c813f-6e68-4b56-bbd2-57c2a8d4b5de tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:41.340578 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-822bdf3d-fc5c-40ac-bad2-bf7c672858dd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:41.356702 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-822bdf3d-fc5c-40ac-bad2-bf7c672858dd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:41.379403 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-822bdf3d-fc5c-40ac-bad2-bf7c672858dd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:41.383439 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-822bdf3d-fc5c-40ac-bad2-bf7c672858dd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1283 microversion: 2.20 time: 0.201141 Dec 15 14:03:41.385927 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 24/56] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:03:41 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1283 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:03:41.466847 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2a511ea8-9579-4755-8c07-1f2c168dfca0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:41.468956 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2a511ea8-9579-4755-8c07-1f2c168dfca0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:41.485734 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2a511ea8-9579-4755-8c07-1f2c168dfca0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:41.490416 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2a511ea8-9579-4755-8c07-1f2c168dfca0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:41.492925 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2a511ea8-9579-4755-8c07-1f2c168dfca0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:41.493629 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2a511ea8-9579-4755-8c07-1f2c168dfca0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:41.512440 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fc2c813f-6e68-4b56-bbd2-57c2a8d4b5de tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:41.526821 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fc2c813f-6e68-4b56-bbd2-57c2a8d4b5de tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.325786 Dec 15 14:03:41.528264 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 33/57] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:41 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:41.609061 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2a511ea8-9579-4755-8c07-1f2c168dfca0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:41.622538 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2a511ea8-9579-4755-8c07-1f2c168dfca0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1241 microversion: 2.1 time: 0.164907 Dec 15 14:03:41.646424 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 25/58] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:41 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1241 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:41.772484 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9f951787-8095-41f0-8ec2-00452c9f6fe4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:41.773497 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9f951787-8095-41f0-8ec2-00452c9f6fe4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:41.782983 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f951787-8095-41f0-8ec2-00452c9f6fe4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:41.783535 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f951787-8095-41f0-8ec2-00452c9f6fe4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:41.784443 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f951787-8095-41f0-8ec2-00452c9f6fe4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:41.784976 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f951787-8095-41f0-8ec2-00452c9f6fe4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:41.857149 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9f951787-8095-41f0-8ec2-00452c9f6fe4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:41.866620 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9f951787-8095-41f0-8ec2-00452c9f6fe4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1225 microversion: 2.1 time: 0.097687 Dec 15 14:03:41.867392 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 34/59] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:41 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:42.404478 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-92abadb1-120c-4411-bbe5-4824658de94c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:42.405835 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-92abadb1-120c-4411-bbe5-4824658de94c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:42.413597 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-92abadb1-120c-4411-bbe5-4824658de94c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:42.420342 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-92abadb1-120c-4411-bbe5-4824658de94c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:42.420342 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-92abadb1-120c-4411-bbe5-4824658de94c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:42.420342 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-92abadb1-120c-4411-bbe5-4824658de94c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:42.542589 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-92abadb1-120c-4411-bbe5-4824658de94c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:42.564332 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a430305c-9e9a-4089-9b98-54a5eaecd409 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:42.565765 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a430305c-9e9a-4089-9b98-54a5eaecd409 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:42.572144 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-92abadb1-120c-4411-bbe5-4824658de94c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:42.574988 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-92abadb1-120c-4411-bbe5-4824658de94c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:42.580598 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-92abadb1-120c-4411-bbe5-4824658de94c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1283 microversion: 2.20 time: 0.180391 Dec 15 14:03:42.583744 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 26/60] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:03:42 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1283 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:03:42.585229 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a430305c-9e9a-4089-9b98-54a5eaecd409 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:42.586496 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a430305c-9e9a-4089-9b98-54a5eaecd409 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:42.588666 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a430305c-9e9a-4089-9b98-54a5eaecd409 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:42.597220 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a430305c-9e9a-4089-9b98-54a5eaecd409 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:42.644769 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fd589fac-43a5-4c43-adb0-b01a71086455 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:42.646115 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fd589fac-43a5-4c43-adb0-b01a71086455 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:42.656579 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd589fac-43a5-4c43-adb0-b01a71086455 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:42.657032 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd589fac-43a5-4c43-adb0-b01a71086455 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:42.658063 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd589fac-43a5-4c43-adb0-b01a71086455 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:42.660964 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd589fac-43a5-4c43-adb0-b01a71086455 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:42.813373 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fd589fac-43a5-4c43-adb0-b01a71086455 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:42.830574 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fd589fac-43a5-4c43-adb0-b01a71086455 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1241 microversion: 2.1 time: 0.194090 Dec 15 14:03:42.832705 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 27/61] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:42 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1241 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:42.888116 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2b443da5-0864-4ece-ae93-16b77a44fc4d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:42.889518 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2b443da5-0864-4ece-ae93-16b77a44fc4d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:42.922554 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b443da5-0864-4ece-ae93-16b77a44fc4d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:42.923623 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b443da5-0864-4ece-ae93-16b77a44fc4d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:42.925145 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b443da5-0864-4ece-ae93-16b77a44fc4d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:42.926187 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b443da5-0864-4ece-ae93-16b77a44fc4d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:43.191193 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2b443da5-0864-4ece-ae93-16b77a44fc4d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:43.204704 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a430305c-9e9a-4089-9b98-54a5eaecd409 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:43.221396 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2b443da5-0864-4ece-ae93-16b77a44fc4d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1225 microversion: 2.1 time: 0.340074 Dec 15 14:03:43.222000 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a430305c-9e9a-4089-9b98-54a5eaecd409 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.665107 Dec 15 14:03:43.223484 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 28/63] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:42 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1225 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:03:43.224809 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 35/63] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:42 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:03:43.608348 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a8f10ecd-989d-4833-b2ea-22208deb2bc3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:43.610349 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a8f10ecd-989d-4833-b2ea-22208deb2bc3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:43.620064 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a8f10ecd-989d-4833-b2ea-22208deb2bc3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:43.624290 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a8f10ecd-989d-4833-b2ea-22208deb2bc3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:43.626011 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a8f10ecd-989d-4833-b2ea-22208deb2bc3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:43.626879 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a8f10ecd-989d-4833-b2ea-22208deb2bc3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:43.752349 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a8f10ecd-989d-4833-b2ea-22208deb2bc3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:43.761601 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a8f10ecd-989d-4833-b2ea-22208deb2bc3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:43.770998 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a8f10ecd-989d-4833-b2ea-22208deb2bc3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:43.772330 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a8f10ecd-989d-4833-b2ea-22208deb2bc3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1283 microversion: 2.20 time: 0.169846 Dec 15 14:03:43.773244 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 29/64] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:03:43 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1283 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:03:43.848884 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e4dc4c9f-ee63-4f4c-839c-4ea5a0d19e29 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:43.849498 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e4dc4c9f-ee63-4f4c-839c-4ea5a0d19e29 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:43.860886 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4dc4c9f-ee63-4f4c-839c-4ea5a0d19e29 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:43.861681 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4dc4c9f-ee63-4f4c-839c-4ea5a0d19e29 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:43.862675 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4dc4c9f-ee63-4f4c-839c-4ea5a0d19e29 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:43.863295 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4dc4c9f-ee63-4f4c-839c-4ea5a0d19e29 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:43.968910 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e4dc4c9f-ee63-4f4c-839c-4ea5a0d19e29 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:43.978284 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e4dc4c9f-ee63-4f4c-839c-4ea5a0d19e29 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1241 microversion: 2.1 time: 0.133632 Dec 15 14:03:43.978788 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 36/65] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:43 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1241 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:44.251749 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-084238d4-2664-4cd1-bddd-4822137c8b11 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:44.254480 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4ee1c5e2-eb95-4394-b97b-6c365c10b769 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:44.255097 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4ee1c5e2-eb95-4394-b97b-6c365c10b769 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:44.257129 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-084238d4-2664-4cd1-bddd-4822137c8b11 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:44.261511 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ee1c5e2-eb95-4394-b97b-6c365c10b769 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:44.262053 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ee1c5e2-eb95-4394-b97b-6c365c10b769 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:44.262846 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ee1c5e2-eb95-4394-b97b-6c365c10b769 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:44.263282 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ee1c5e2-eb95-4394-b97b-6c365c10b769 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:44.263697 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-084238d4-2664-4cd1-bddd-4822137c8b11 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:44.264339 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-084238d4-2664-4cd1-bddd-4822137c8b11 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:44.265289 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-084238d4-2664-4cd1-bddd-4822137c8b11 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:44.266151 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-084238d4-2664-4cd1-bddd-4822137c8b11 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:44.366419 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-084238d4-2664-4cd1-bddd-4822137c8b11 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:44.375255 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-084238d4-2664-4cd1-bddd-4822137c8b11 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1225 microversion: 2.1 time: 0.130304 Dec 15 14:03:44.376223 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 30/66] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:44 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1225 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:44.451534 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4ee1c5e2-eb95-4394-b97b-6c365c10b769 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:44.459945 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4ee1c5e2-eb95-4394-b97b-6c365c10b769 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.213201 Dec 15 14:03:44.460871 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 37/67] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:44 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:44.756851 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d72d8ba7-067e-439b-8c3d-fa0a13cafe5e tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] Calling method '.version_select at 0x7faa3caabe50>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:44.791661 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5f504d42-ed5c-4fe5-bf66-79292fe8b5d3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:44.792302 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5f504d42-ed5c-4fe5-bf66-79292fe8b5d3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:44.810022 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f504d42-ed5c-4fe5-bf66-79292fe8b5d3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:44.810492 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f504d42-ed5c-4fe5-bf66-79292fe8b5d3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:44.812506 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f504d42-ed5c-4fe5-bf66-79292fe8b5d3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:44.812930 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f504d42-ed5c-4fe5-bf66-79292fe8b5d3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:44.900975 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d72d8ba7-067e-439b-8c3d-fa0a13cafe5e tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/08d588d6-6244-4d18-8bc6-2d0c23f1f7e9" status: 200 len: 350 microversion: 2.1 time: 0.153245 Dec 15 14:03:44.901989 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 31/68] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:03:44 2021] GET /compute/v2.1/os-volumes/08d588d6-6244-4d18-8bc6-2d0c23f1f7e9 => generated 350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:44.932898 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5f504d42-ed5c-4fe5-bf66-79292fe8b5d3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:44.947236 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5f504d42-ed5c-4fe5-bf66-79292fe8b5d3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:44.953577 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5f504d42-ed5c-4fe5-bf66-79292fe8b5d3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:44.955099 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5f504d42-ed5c-4fe5-bf66-79292fe8b5d3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1283 microversion: 2.20 time: 0.167315 Dec 15 14:03:44.958342 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 38/69] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:03:44 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1283 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:03:44.996533 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-188c98ca-bdf5-49d3-acfb-334f977d276f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:44.997896 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-188c98ca-bdf5-49d3-acfb-334f977d276f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:45.006213 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-188c98ca-bdf5-49d3-acfb-334f977d276f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:45.006945 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-188c98ca-bdf5-49d3-acfb-334f977d276f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:45.008429 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-188c98ca-bdf5-49d3-acfb-334f977d276f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:45.009076 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-188c98ca-bdf5-49d3-acfb-334f977d276f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:45.155995 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-188c98ca-bdf5-49d3-acfb-334f977d276f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:45.168953 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-188c98ca-bdf5-49d3-acfb-334f977d276f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1241 microversion: 2.1 time: 0.176554 Dec 15 14:03:45.172181 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 32/70] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:44 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1241 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:03:45.392933 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c24e4f5f-d127-4134-94b2-c47004ed77ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:45.393829 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c24e4f5f-d127-4134-94b2-c47004ed77ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:45.413657 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c24e4f5f-d127-4134-94b2-c47004ed77ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:45.414393 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c24e4f5f-d127-4134-94b2-c47004ed77ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:45.415941 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c24e4f5f-d127-4134-94b2-c47004ed77ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:45.418429 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c24e4f5f-d127-4134-94b2-c47004ed77ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:45.478780 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bfed3c42-2742-4944-a62c-0a88dcf13525 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:45.479368 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bfed3c42-2742-4944-a62c-0a88dcf13525 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:45.489519 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bfed3c42-2742-4944-a62c-0a88dcf13525 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:45.499642 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bfed3c42-2742-4944-a62c-0a88dcf13525 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:45.500834 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bfed3c42-2742-4944-a62c-0a88dcf13525 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:45.503144 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bfed3c42-2742-4944-a62c-0a88dcf13525 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:45.608403 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c24e4f5f-d127-4134-94b2-c47004ed77ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:45.640543 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c24e4f5f-d127-4134-94b2-c47004ed77ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1225 microversion: 2.1 time: 0.251558 Dec 15 14:03:45.641054 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 39/71] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:45 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1225 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:45.830119 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bfed3c42-2742-4944-a62c-0a88dcf13525 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:45.840333 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bfed3c42-2742-4944-a62c-0a88dcf13525 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.366022 Dec 15 14:03:45.841832 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 33/72] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:45 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:45.976792 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-db115a0c-2fef-4fef-bf1f-f262f98074b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:45.977479 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-db115a0c-2fef-4fef-bf1f-f262f98074b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:45.986819 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db115a0c-2fef-4fef-bf1f-f262f98074b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:45.987557 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db115a0c-2fef-4fef-bf1f-f262f98074b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:45.989054 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db115a0c-2fef-4fef-bf1f-f262f98074b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:45.989280 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db115a0c-2fef-4fef-bf1f-f262f98074b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:46.080097 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-db115a0c-2fef-4fef-bf1f-f262f98074b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:46.089706 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-db115a0c-2fef-4fef-bf1f-f262f98074b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:46.091489 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-db115a0c-2fef-4fef-bf1f-f262f98074b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:46.093929 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-db115a0c-2fef-4fef-bf1f-f262f98074b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1283 microversion: 2.20 time: 0.120316 Dec 15 14:03:46.095014 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 40/73] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:03:45 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1283 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:03:46.189184 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b5bc2404-15b3-4a19-9341-fccb99743249 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:46.189834 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b5bc2404-15b3-4a19-9341-fccb99743249 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:46.196248 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5bc2404-15b3-4a19-9341-fccb99743249 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:46.196944 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5bc2404-15b3-4a19-9341-fccb99743249 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:46.197924 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5bc2404-15b3-4a19-9341-fccb99743249 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:46.198523 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5bc2404-15b3-4a19-9341-fccb99743249 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:46.288196 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b5bc2404-15b3-4a19-9341-fccb99743249 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:46.299164 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b5bc2404-15b3-4a19-9341-fccb99743249 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1241 microversion: 2.1 time: 0.114650 Dec 15 14:03:46.299900 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 34/74] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:46 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1241 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:46.524210 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d69e6062-7d53-4213-a8be-5ff90ae3051b tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] Calling method '.version_select at 0x7faa3da62af0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:46.586303 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d69e6062-7d53-4213-a8be-5ff90ae3051b tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/270abad4-75cc-41f0-8cac-869d18391b24" status: 200 len: 350 microversion: 2.1 time: 0.066328 Dec 15 14:03:46.587154 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 41/75] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:03:46 2021] GET /compute/v2.1/os-volumes/270abad4-75cc-41f0-8cac-869d18391b24 => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:46.658278 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bbae5dc2-8cae-4f33-a7c0-096a43712242 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:46.659191 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bbae5dc2-8cae-4f33-a7c0-096a43712242 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:46.666355 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bbae5dc2-8cae-4f33-a7c0-096a43712242 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:46.669237 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bbae5dc2-8cae-4f33-a7c0-096a43712242 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:46.670236 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bbae5dc2-8cae-4f33-a7c0-096a43712242 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:46.671005 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bbae5dc2-8cae-4f33-a7c0-096a43712242 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:46.792725 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bbae5dc2-8cae-4f33-a7c0-096a43712242 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:46.803448 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bbae5dc2-8cae-4f33-a7c0-096a43712242 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1225 microversion: 2.1 time: 0.149906 Dec 15 14:03:46.814589 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 35/76] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:46 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1225 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:46.860736 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fab9e3ac-69ce-45e3-a5e7-9a8734d87def tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:46.861584 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fab9e3ac-69ce-45e3-a5e7-9a8734d87def tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:46.868741 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fab9e3ac-69ce-45e3-a5e7-9a8734d87def tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:46.869201 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fab9e3ac-69ce-45e3-a5e7-9a8734d87def tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:46.870221 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fab9e3ac-69ce-45e3-a5e7-9a8734d87def tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:46.870662 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fab9e3ac-69ce-45e3-a5e7-9a8734d87def tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:47.063798 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fab9e3ac-69ce-45e3-a5e7-9a8734d87def tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:47.077652 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fab9e3ac-69ce-45e3-a5e7-9a8734d87def tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.223383 Dec 15 14:03:47.078671 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 42/77] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:46 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:47.113393 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-60a8c517-446b-4a38-bdbf-b229e4b55738 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:47.114188 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-60a8c517-446b-4a38-bdbf-b229e4b55738 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:47.120256 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60a8c517-446b-4a38-bdbf-b229e4b55738 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:47.120712 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60a8c517-446b-4a38-bdbf-b229e4b55738 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:47.121581 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60a8c517-446b-4a38-bdbf-b229e4b55738 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:47.122038 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60a8c517-446b-4a38-bdbf-b229e4b55738 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:47.186735 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-60a8c517-446b-4a38-bdbf-b229e4b55738 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:47.195061 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-60a8c517-446b-4a38-bdbf-b229e4b55738 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:47.196649 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-60a8c517-446b-4a38-bdbf-b229e4b55738 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:47.197968 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-60a8c517-446b-4a38-bdbf-b229e4b55738 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1283 microversion: 2.20 time: 0.088938 Dec 15 14:03:47.199200 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 36/78] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:03:47 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1283 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:03:47.316346 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9d7b2dab-1c63-4268-bf34-af3468e78192 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:47.317091 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9d7b2dab-1c63-4268-bf34-af3468e78192 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:47.323663 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d7b2dab-1c63-4268-bf34-af3468e78192 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:47.324110 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d7b2dab-1c63-4268-bf34-af3468e78192 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:47.324884 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d7b2dab-1c63-4268-bf34-af3468e78192 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:47.325313 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d7b2dab-1c63-4268-bf34-af3468e78192 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:47.387813 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9d7b2dab-1c63-4268-bf34-af3468e78192 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:47.396363 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9d7b2dab-1c63-4268-bf34-af3468e78192 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1241 microversion: 2.1 time: 0.083682 Dec 15 14:03:47.397060 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 43/79] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:47 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:47.821377 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-46f70cc5-9e8b-439a-8cf5-1d5e8475c6b5 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:47.822242 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-46f70cc5-9e8b-439a-8cf5-1d5e8475c6b5 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:47.828912 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-46f70cc5-9e8b-439a-8cf5-1d5e8475c6b5 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:47.829359 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-46f70cc5-9e8b-439a-8cf5-1d5e8475c6b5 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:47.830228 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-46f70cc5-9e8b-439a-8cf5-1d5e8475c6b5 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:47.830655 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-46f70cc5-9e8b-439a-8cf5-1d5e8475c6b5 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:47.896600 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-46f70cc5-9e8b-439a-8cf5-1d5e8475c6b5 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:47.905074 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-46f70cc5-9e8b-439a-8cf5-1d5e8475c6b5 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1225 microversion: 2.1 time: 0.087396 Dec 15 14:03:47.905849 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 37/80] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:47 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:48.037196 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f27e7037-911f-40ed-ac04-f7f7a38c5270 tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] Calling method '.version_select at 0x7faa3da62940>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:48.096594 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f27e7037-911f-40ed-ac04-f7f7a38c5270 tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/149a676f-2f1c-4daf-b55a-fa8887ad33d0" status: 200 len: 351 microversion: 2.1 time: 0.064190 Dec 15 14:03:48.097819 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5097dc3e-8339-4666-9b9a-a15615dcfdf1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:48.098278 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 44/81] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:03:48 2021] GET /compute/v2.1/os-volumes/149a676f-2f1c-4daf-b55a-fa8887ad33d0 => generated 351 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:48.099226 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5097dc3e-8339-4666-9b9a-a15615dcfdf1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:48.106723 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5097dc3e-8339-4666-9b9a-a15615dcfdf1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:48.108750 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5097dc3e-8339-4666-9b9a-a15615dcfdf1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:48.110665 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5097dc3e-8339-4666-9b9a-a15615dcfdf1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:48.111552 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5097dc3e-8339-4666-9b9a-a15615dcfdf1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:48.111681 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c35a56e0-1f46-4ce4-a843-d858b2c9b138 tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] Calling method '.version_select at 0x7faa3da60ca0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:48.302662 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c35a56e0-1f46-4ce4-a843-d858b2c9b138 tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.196546 Dec 15 14:03:48.303253 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 45/82] 10.222.0.42 () {58 vars in 1133 bytes} [Wed Dec 15 14:03:48 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:03:48.323523 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-791b5481-253a-47a7-b654-af32293bcd4c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:48.325397 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-791b5481-253a-47a7-b654-af32293bcd4c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:48.347184 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-791b5481-253a-47a7-b654-af32293bcd4c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:48.349011 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-791b5481-253a-47a7-b654-af32293bcd4c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:48.352746 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-791b5481-253a-47a7-b654-af32293bcd4c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:48.353222 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-791b5481-253a-47a7-b654-af32293bcd4c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:48.416452 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5097dc3e-8339-4666-9b9a-a15615dcfdf1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:48.426064 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5097dc3e-8339-4666-9b9a-a15615dcfdf1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.334462 Dec 15 14:03:48.429124 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 38/83] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:48 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:03:48.437108 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6b612731-561b-401e-8bb5-068b07932d38 tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] Calling method '.version_select at 0x7faa3ca4f0d0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:48.477997 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-791b5481-253a-47a7-b654-af32293bcd4c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:48.489126 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-791b5481-253a-47a7-b654-af32293bcd4c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:48.491659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-791b5481-253a-47a7-b654-af32293bcd4c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:48.492879 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-791b5481-253a-47a7-b654-af32293bcd4c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1283 microversion: 2.20 time: 0.182717 Dec 15 14:03:48.516802 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 46/84] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:03:48 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1283 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:03:48.523022 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fb896e39-7368-484f-b36e-2aab4c82560a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:48.523711 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fb896e39-7368-484f-b36e-2aab4c82560a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:48.530633 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fb896e39-7368-484f-b36e-2aab4c82560a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:48.531486 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fb896e39-7368-484f-b36e-2aab4c82560a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:48.532621 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fb896e39-7368-484f-b36e-2aab4c82560a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:48.533257 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fb896e39-7368-484f-b36e-2aab4c82560a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:48.562084 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6b612731-561b-401e-8bb5-068b07932d38 tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.131185 Dec 15 14:03:48.570341 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 39/85] 10.222.0.42 () {58 vars in 1148 bytes} [Wed Dec 15 14:03:48 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:48.575203 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-46e8b721-925f-4dfd-9533-ec3dbb8323ed tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] Calling method '.version_select at 0x7faa3ca5e1f0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:48.640900 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fb896e39-7368-484f-b36e-2aab4c82560a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:48.648785 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fb896e39-7368-484f-b36e-2aab4c82560a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1233 microversion: 2.1 time: 0.130386 Dec 15 14:03:48.662875 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 47/86] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:48 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1233 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:48.690325 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-46e8b721-925f-4dfd-9533-ec3dbb8323ed tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.118612 Dec 15 14:03:48.690907 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 40/87] 10.222.0.42 () {58 vars in 1133 bytes} [Wed Dec 15 14:03:48 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:48.702332 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7fc73bc8-591d-4801-9ac0-046a83cd7ce9 tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] Calling method '.version_select at 0x7faa3c9be9d0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:48.860651 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7fc73bc8-591d-4801-9ac0-046a83cd7ce9 tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.161687 Dec 15 14:03:48.861434 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 48/88] 10.222.0.42 () {58 vars in 1166 bytes} [Wed Dec 15 14:03:48 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:48.873507 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-784b47c7-b6cb-4d03-a96a-90047f9cd0ff tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] Calling method '.version_select at 0x7faa3ca6c8b0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:48.923813 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8b629f8f-bffe-4d49-ac2e-341821f5a38c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:48.924931 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8b629f8f-bffe-4d49-ac2e-341821f5a38c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:48.941108 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8b629f8f-bffe-4d49-ac2e-341821f5a38c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:48.943169 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8b629f8f-bffe-4d49-ac2e-341821f5a38c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:48.944874 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8b629f8f-bffe-4d49-ac2e-341821f5a38c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:48.945331 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8b629f8f-bffe-4d49-ac2e-341821f5a38c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:49.016048 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-784b47c7-b6cb-4d03-a96a-90047f9cd0ff tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.146191 Dec 15 14:03:49.016869 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 41/89] 10.222.0.42 () {58 vars in 1169 bytes} [Wed Dec 15 14:03:48 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:49.029546 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e0197db0-5bfb-4982-bcb5-619b4d2e93c3 tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] Calling method '.version_select at 0x7faa3ca6c430>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:49.164801 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e0197db0-5bfb-4982-bcb5-619b4d2e93c3 tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.139337 Dec 15 14:03:49.174072 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 42/90] 10.222.0.42 () {58 vars in 1154 bytes} [Wed Dec 15 14:03:49 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:49.180884 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b9f6e289-c6cd-42fc-9ceb-ad9ef3bd4554 tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] Calling method '.version_select at 0x7faa3ca5edc0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:49.284525 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8b629f8f-bffe-4d49-ac2e-341821f5a38c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:49.308740 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8b629f8f-bffe-4d49-ac2e-341821f5a38c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1273 microversion: 2.1 time: 0.385304 Dec 15 14:03:49.311438 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 49/91] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:48 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1273 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:49.375558 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b9f6e289-c6cd-42fc-9ceb-ad9ef3bd4554 tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.198513 Dec 15 14:03:49.376352 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 43/92] 10.222.0.42 () {58 vars in 1187 bytes} [Wed Dec 15 14:03:49 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:49.391148 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e08f4743-243f-41f0-a081-b4dd8edaeb23 tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] Calling method '.version_select at 0x7faa3c9be940>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:49.443118 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bc900f76-6c09-4e32-84f4-cf862560dfc1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:49.443814 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bc900f76-6c09-4e32-84f4-cf862560dfc1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:49.454584 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bc900f76-6c09-4e32-84f4-cf862560dfc1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:49.455044 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bc900f76-6c09-4e32-84f4-cf862560dfc1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:49.457679 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bc900f76-6c09-4e32-84f4-cf862560dfc1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:49.465016 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bc900f76-6c09-4e32-84f4-cf862560dfc1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:49.537529 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e08f4743-243f-41f0-a081-b4dd8edaeb23 tempest-VolumesTestJSON-1876638699 tempest-VolumesTestJSON-1876638699-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.150227 Dec 15 14:03:49.538147 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 50/93] 10.222.0.42 () {58 vars in 1154 bytes} [Wed Dec 15 14:03:49 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:49.551579 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0e302266-6e1f-4cda-b1d0-4d7401f13cc4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:49.552375 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0e302266-6e1f-4cda-b1d0-4d7401f13cc4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:49.560086 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e302266-6e1f-4cda-b1d0-4d7401f13cc4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:49.560785 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e302266-6e1f-4cda-b1d0-4d7401f13cc4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:49.561794 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e302266-6e1f-4cda-b1d0-4d7401f13cc4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:49.562398 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e302266-6e1f-4cda-b1d0-4d7401f13cc4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:49.919123 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0e302266-6e1f-4cda-b1d0-4d7401f13cc4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:49.935149 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0e302266-6e1f-4cda-b1d0-4d7401f13cc4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:49.946971 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0e302266-6e1f-4cda-b1d0-4d7401f13cc4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:49.954083 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0e302266-6e1f-4cda-b1d0-4d7401f13cc4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1275 microversion: 2.20 time: 0.400591 Dec 15 14:03:49.955221 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 51/94] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:03:49 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1275 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:03:49.961645 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8360d51e-0ce3-404a-befe-45e90e3ad9e9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:49.962244 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8360d51e-0ce3-404a-befe-45e90e3ad9e9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:49.991548 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8360d51e-0ce3-404a-befe-45e90e3ad9e9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:49.998473 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8360d51e-0ce3-404a-befe-45e90e3ad9e9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:50.013590 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8360d51e-0ce3-404a-befe-45e90e3ad9e9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:50.016971 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8360d51e-0ce3-404a-befe-45e90e3ad9e9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:50.260460 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8360d51e-0ce3-404a-befe-45e90e3ad9e9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:50.271712 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8360d51e-0ce3-404a-befe-45e90e3ad9e9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1297 microversion: 2.1 time: 0.315987 Dec 15 14:03:50.272752 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 52/95] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:49 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1297 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:50.384210 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-56ac95c7-9791-49c9-b5bb-827b2ad565ef tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:50.384893 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-56ac95c7-9791-49c9-b5bb-827b2ad565ef tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:50.398783 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56ac95c7-9791-49c9-b5bb-827b2ad565ef tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:50.405448 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56ac95c7-9791-49c9-b5bb-827b2ad565ef tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:50.406598 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56ac95c7-9791-49c9-b5bb-827b2ad565ef tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:50.407373 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56ac95c7-9791-49c9-b5bb-827b2ad565ef tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:50.433092 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bc900f76-6c09-4e32-84f4-cf862560dfc1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:50.448200 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bc900f76-6c09-4e32-84f4-cf862560dfc1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 1.008588 Dec 15 14:03:50.448832 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 44/96] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:49 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:03:50.690873 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-56ac95c7-9791-49c9-b5bb-827b2ad565ef tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:50.705918 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-56ac95c7-9791-49c9-b5bb-827b2ad565ef tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1279 microversion: 2.1 time: 0.325182 Dec 15 14:03:50.709855 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 53/97] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:50 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1279 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:03:50.973839 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-809af042-02f9-4553-9f61-0cd09d030723 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:50.974567 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-809af042-02f9-4553-9f61-0cd09d030723 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:50.987538 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-809af042-02f9-4553-9f61-0cd09d030723 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:50.988071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-809af042-02f9-4553-9f61-0cd09d030723 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:50.991779 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-809af042-02f9-4553-9f61-0cd09d030723 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:50.992243 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-809af042-02f9-4553-9f61-0cd09d030723 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:51.210038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-399bde32-6f1d-4bf5-a1b2-b4454855324d req-3c013444-3b2b-444f-9167-ceb5507b652b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f68da2b-2ed8-4892-85a6-1612edd7b6fc", "tag": "223697b4-2610-4672-9cd7-955d6898e0bb"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:03:51.213166 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:03:51.213166 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:03:51.223182 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-809af042-02f9-4553-9f61-0cd09d030723 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:51.235907 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-809af042-02f9-4553-9f61-0cd09d030723 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:51.238484 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-399bde32-6f1d-4bf5-a1b2-b4454855324d req-3c013444-3b2b-444f-9167-ceb5507b652b service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:51.240372 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-809af042-02f9-4553-9f61-0cd09d030723 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:51.241581 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-809af042-02f9-4553-9f61-0cd09d030723 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1337 microversion: 2.20 time: 0.272623 Dec 15 14:03:51.242193 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 45/98] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:03:50 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1337 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:03:51.242883 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-399bde32-6f1d-4bf5-a1b2-b4454855324d req-3c013444-3b2b-444f-9167-ceb5507b652b service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:51.266332 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-399bde32-6f1d-4bf5-a1b2-b4454855324d req-3c013444-3b2b-444f-9167-ceb5507b652b service nova] Creating event network-changed:223697b4-2610-4672-9cd7-955d6898e0bb for instance 3f68da2b-2ed8-4892-85a6-1612edd7b6fc on hv-cinder-82182 Dec 15 14:03:51.267332 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-399bde32-6f1d-4bf5-a1b2-b4454855324d req-3c013444-3b2b-444f-9167-ceb5507b652b service nova] Acquired lock "compute-rpcapi-router" {{(pid=116103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 14:03:51.269011 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86fce24a-67f1-4e53-b3fc-79d25f155341 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:51.270015 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86fce24a-67f1-4e53-b3fc-79d25f155341 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:51.271441 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86fce24a-67f1-4e53-b3fc-79d25f155341 None None] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:51.272022 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86fce24a-67f1-4e53-b3fc-79d25f155341 None None] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:51.290226 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-aff5758a-698a-4113-bcf1-8e7314984cca tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:51.291012 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-aff5758a-698a-4113-bcf1-8e7314984cca tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:51.291930 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.compute.rpcapi [None req-86fce24a-67f1-4e53-b3fc-79d25f155341 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 14:03:51.293748 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86fce24a-67f1-4e53-b3fc-79d25f155341 None None] Releasing lock "compute-rpcapi-router" {{(pid=116103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 14:03:51.299623 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aff5758a-698a-4113-bcf1-8e7314984cca tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:51.300301 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aff5758a-698a-4113-bcf1-8e7314984cca tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:51.301274 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aff5758a-698a-4113-bcf1-8e7314984cca tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:51.301962 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aff5758a-698a-4113-bcf1-8e7314984cca tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:51.356237 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-86fce24a-67f1-4e53-b3fc-79d25f155341 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250258 Dec 15 14:03:51.358345 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 54/99] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:03:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:03:51.452455 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-aff5758a-698a-4113-bcf1-8e7314984cca tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:51.464876 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-aff5758a-698a-4113-bcf1-8e7314984cca tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1295 microversion: 2.1 time: 0.177687 Dec 15 14:03:51.468833 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 46/100] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:51 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1295 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:51.471883 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7405629a-9a44-4400-9dd5-13d5b5945c39 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:51.474710 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7405629a-9a44-4400-9dd5-13d5b5945c39 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:51.488769 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7405629a-9a44-4400-9dd5-13d5b5945c39 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:51.489238 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7405629a-9a44-4400-9dd5-13d5b5945c39 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:51.490108 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7405629a-9a44-4400-9dd5-13d5b5945c39 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:51.490549 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7405629a-9a44-4400-9dd5-13d5b5945c39 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:51.727277 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-db635a5c-1932-4709-911a-f8db783d3aae tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:51.728117 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-db635a5c-1932-4709-911a-f8db783d3aae tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:51.738764 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db635a5c-1932-4709-911a-f8db783d3aae tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:51.741162 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db635a5c-1932-4709-911a-f8db783d3aae tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:51.742120 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db635a5c-1932-4709-911a-f8db783d3aae tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:51.743268 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db635a5c-1932-4709-911a-f8db783d3aae tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:51.969563 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-db635a5c-1932-4709-911a-f8db783d3aae tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:51.977832 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-db635a5c-1932-4709-911a-f8db783d3aae tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1279 microversion: 2.1 time: 0.254289 Dec 15 14:03:51.978615 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 47/101] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:51 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1279 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:03:52.086200 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7405629a-9a44-4400-9dd5-13d5b5945c39 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:52.098174 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7405629a-9a44-4400-9dd5-13d5b5945c39 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.632533 Dec 15 14:03:52.099373 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 55/102] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:51 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:52.260953 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b1fc6caa-aefb-48f2-8bca-474dd0b04d6a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:52.261693 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b1fc6caa-aefb-48f2-8bca-474dd0b04d6a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:52.270144 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1fc6caa-aefb-48f2-8bca-474dd0b04d6a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:52.273768 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1fc6caa-aefb-48f2-8bca-474dd0b04d6a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:52.275220 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1fc6caa-aefb-48f2-8bca-474dd0b04d6a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:52.277640 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1fc6caa-aefb-48f2-8bca-474dd0b04d6a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:52.486946 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5ffd1f9b-1306-4952-a88d-8c5a774afa43 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:52.487722 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5ffd1f9b-1306-4952-a88d-8c5a774afa43 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:52.499247 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ffd1f9b-1306-4952-a88d-8c5a774afa43 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:52.499989 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ffd1f9b-1306-4952-a88d-8c5a774afa43 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:52.503363 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ffd1f9b-1306-4952-a88d-8c5a774afa43 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:52.503905 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ffd1f9b-1306-4952-a88d-8c5a774afa43 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:52.556439 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b1fc6caa-aefb-48f2-8bca-474dd0b04d6a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:52.573555 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b1fc6caa-aefb-48f2-8bca-474dd0b04d6a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:52.575280 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b1fc6caa-aefb-48f2-8bca-474dd0b04d6a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:52.576513 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b1fc6caa-aefb-48f2-8bca-474dd0b04d6a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1337 microversion: 2.20 time: 0.319811 Dec 15 14:03:52.578580 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 48/103] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:03:52 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1337 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:03:52.998493 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f2ac1643-ac22-42c9-a980-34627230fe99 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:52.999517 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f2ac1643-ac22-42c9-a980-34627230fe99 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:53.005983 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f2ac1643-ac22-42c9-a980-34627230fe99 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:53.006786 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f2ac1643-ac22-42c9-a980-34627230fe99 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:53.007625 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f2ac1643-ac22-42c9-a980-34627230fe99 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:53.008296 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f2ac1643-ac22-42c9-a980-34627230fe99 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:53.232541 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5ffd1f9b-1306-4952-a88d-8c5a774afa43 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:53.246332 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5ffd1f9b-1306-4952-a88d-8c5a774afa43 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.765531 Dec 15 14:03:53.247071 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 56/104] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:52 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:53.253762 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c3a785cb-7919-4b30-b464-f0eab2183ae8 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:53.255074 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c3a785cb-7919-4b30-b464-f0eab2183ae8 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:53.264456 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3a785cb-7919-4b30-b464-f0eab2183ae8 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:53.265710 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3a785cb-7919-4b30-b464-f0eab2183ae8 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:53.266914 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3a785cb-7919-4b30-b464-f0eab2183ae8 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:53.267566 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3a785cb-7919-4b30-b464-f0eab2183ae8 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:53.850966 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f2ac1643-ac22-42c9-a980-34627230fe99 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:53.866018 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f2ac1643-ac22-42c9-a980-34627230fe99 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.872521 Dec 15 14:03:53.868592 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 49/105] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:52 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:53.881098 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bbe81ba0-e4f5-4bb0-9185-1eea410beb28 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:53.883344 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bbe81ba0-e4f5-4bb0-9185-1eea410beb28 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:53.891746 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bbe81ba0-e4f5-4bb0-9185-1eea410beb28 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:53.892274 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bbe81ba0-e4f5-4bb0-9185-1eea410beb28 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:53.893272 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bbe81ba0-e4f5-4bb0-9185-1eea410beb28 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:53.893749 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bbe81ba0-e4f5-4bb0-9185-1eea410beb28 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:54.132198 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c3a785cb-7919-4b30-b464-f0eab2183ae8 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:54.143075 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c3a785cb-7919-4b30-b464-f0eab2183ae8 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.894443 Dec 15 14:03:54.145923 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 57/106] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:53 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:54.270963 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6f593ad8-d97d-4a67-8fbf-b2bc7b1105a9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:54.271975 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6f593ad8-d97d-4a67-8fbf-b2bc7b1105a9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:54.289844 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f593ad8-d97d-4a67-8fbf-b2bc7b1105a9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:54.290980 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f593ad8-d97d-4a67-8fbf-b2bc7b1105a9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:54.294627 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f593ad8-d97d-4a67-8fbf-b2bc7b1105a9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:54.295259 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f593ad8-d97d-4a67-8fbf-b2bc7b1105a9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:54.529416 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bbe81ba0-e4f5-4bb0-9185-1eea410beb28 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:54.537365 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bbe81ba0-e4f5-4bb0-9185-1eea410beb28 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:54.538889 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bbe81ba0-e4f5-4bb0-9185-1eea410beb28 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:54.540023 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bbe81ba0-e4f5-4bb0-9185-1eea410beb28 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.668203 Dec 15 14:03:54.540599 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 50/107] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:03:53 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:03:54.663501 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-2f57cbb3-413b-4d26-9ccf-b5b4cf792b8d req-143d307e-b9ad-46d3-9239-b4246cf93020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfccdaf0-2b79-4ace-a816-8c76eba7f48b", "tag": "c6825246-0c77-4125-b93c-02f824de479b"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:03:54.665663 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:03:54.665663 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:03:54.681425 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-2f57cbb3-413b-4d26-9ccf-b5b4cf792b8d req-143d307e-b9ad-46d3-9239-b4246cf93020 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:54.681425 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-2f57cbb3-413b-4d26-9ccf-b5b4cf792b8d req-143d307e-b9ad-46d3-9239-b4246cf93020 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:54.706644 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-2f57cbb3-413b-4d26-9ccf-b5b4cf792b8d req-143d307e-b9ad-46d3-9239-b4246cf93020 service nova] Creating event network-changed:c6825246-0c77-4125-b93c-02f824de479b for instance bfccdaf0-2b79-4ace-a816-8c76eba7f48b on hv-cinder-82182 Dec 15 14:03:54.707186 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-2f57cbb3-413b-4d26-9ccf-b5b4cf792b8d req-143d307e-b9ad-46d3-9239-b4246cf93020 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116104) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 14:03:54.708682 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5dfac4f3-31f0-4497-83d5-1fe8551dd40a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:54.710927 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5dfac4f3-31f0-4497-83d5-1fe8551dd40a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:54.712011 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5dfac4f3-31f0-4497-83d5-1fe8551dd40a None None] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:54.712638 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5dfac4f3-31f0-4497-83d5-1fe8551dd40a None None] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:54.728596 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.compute.rpcapi [None req-5dfac4f3-31f0-4497-83d5-1fe8551dd40a None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 14:03:54.728993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5dfac4f3-31f0-4497-83d5-1fe8551dd40a None None] Releasing lock "compute-rpcapi-router" {{(pid=116104) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 14:03:54.767073 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5dfac4f3-31f0-4497-83d5-1fe8551dd40a None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206616 Dec 15 14:03:54.768340 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 51/108] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:03:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:54.887975 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f11e15bd-3071-4e28-881c-ef02277c1413 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:54.889771 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f11e15bd-3071-4e28-881c-ef02277c1413 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:54.899598 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f11e15bd-3071-4e28-881c-ef02277c1413 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:54.900509 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f11e15bd-3071-4e28-881c-ef02277c1413 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:54.902626 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f11e15bd-3071-4e28-881c-ef02277c1413 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:54.903276 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f11e15bd-3071-4e28-881c-ef02277c1413 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:55.244641 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6f593ad8-d97d-4a67-8fbf-b2bc7b1105a9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:55.261079 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6f593ad8-d97d-4a67-8fbf-b2bc7b1105a9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.993127 Dec 15 14:03:55.262602 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 58/109] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:54 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:03:55.267732 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-165a4a61-7898-4cac-ac0d-90dd902b8d7a tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:55.268412 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-165a4a61-7898-4cac-ac0d-90dd902b8d7a tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:55.274734 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-165a4a61-7898-4cac-ac0d-90dd902b8d7a tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:55.275437 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-165a4a61-7898-4cac-ac0d-90dd902b8d7a tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:55.276416 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-165a4a61-7898-4cac-ac0d-90dd902b8d7a tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:55.277035 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-165a4a61-7898-4cac-ac0d-90dd902b8d7a tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:55.681413 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f11e15bd-3071-4e28-881c-ef02277c1413 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:55.699780 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f11e15bd-3071-4e28-881c-ef02277c1413 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.816366 Dec 15 14:03:55.700421 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 52/110] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:54 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:55.709331 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e1f2496e-c9b6-479f-96f3-77c48aef10dc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:55.714551 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e1f2496e-c9b6-479f-96f3-77c48aef10dc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:55.726946 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1f2496e-c9b6-479f-96f3-77c48aef10dc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:55.727560 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1f2496e-c9b6-479f-96f3-77c48aef10dc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:55.728504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1f2496e-c9b6-479f-96f3-77c48aef10dc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:55.729074 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1f2496e-c9b6-479f-96f3-77c48aef10dc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:55.831411 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-165a4a61-7898-4cac-ac0d-90dd902b8d7a tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:55.855439 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-165a4a61-7898-4cac-ac0d-90dd902b8d7a tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.590532 Dec 15 14:03:55.857903 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 59/111] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:55 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:56.096491 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e1f2496e-c9b6-479f-96f3-77c48aef10dc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:56.111553 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e1f2496e-c9b6-479f-96f3-77c48aef10dc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:56.118276 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e1f2496e-c9b6-479f-96f3-77c48aef10dc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:56.121627 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e1f2496e-c9b6-479f-96f3-77c48aef10dc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.416565 Dec 15 14:03:56.132416 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 53/112] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:03:55 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:03:56.141110 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-bd89b9c9-a897-4065-936f-d4fee0e90498 req-074e6c1e-6aaa-44ef-b8fd-0b1faab4019e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbed1ca6-db9b-4346-9edd-5047a3e302e7", "tag": "0ac2210e-a283-4a63-80c5-bed03c1478de"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:03:56.142896 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:03:56.142896 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:03:56.160273 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-bd89b9c9-a897-4065-936f-d4fee0e90498 req-074e6c1e-6aaa-44ef-b8fd-0b1faab4019e service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:56.160722 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-bd89b9c9-a897-4065-936f-d4fee0e90498 req-074e6c1e-6aaa-44ef-b8fd-0b1faab4019e service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:56.204002 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-bd89b9c9-a897-4065-936f-d4fee0e90498 req-074e6c1e-6aaa-44ef-b8fd-0b1faab4019e service nova] Creating event network-changed:0ac2210e-a283-4a63-80c5-bed03c1478de for instance cbed1ca6-db9b-4346-9edd-5047a3e302e7 on hv-cinder-82182 Dec 15 14:03:56.221109 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-bd89b9c9-a897-4065-936f-d4fee0e90498 req-074e6c1e-6aaa-44ef-b8fd-0b1faab4019e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081264 Dec 15 14:03:56.221923 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 60/113] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:03:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:56.278132 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-713dbeab-755f-41d3-9bef-9d875d8eeb77 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:56.278752 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-713dbeab-755f-41d3-9bef-9d875d8eeb77 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:56.287232 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-713dbeab-755f-41d3-9bef-9d875d8eeb77 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:56.288656 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-713dbeab-755f-41d3-9bef-9d875d8eeb77 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:56.290387 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-713dbeab-755f-41d3-9bef-9d875d8eeb77 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:56.291041 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-713dbeab-755f-41d3-9bef-9d875d8eeb77 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:56.719051 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b6734cad-2723-456f-b501-3cea91b117d2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:56.721119 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b6734cad-2723-456f-b501-3cea91b117d2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:56.733255 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6734cad-2723-456f-b501-3cea91b117d2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:56.735254 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6734cad-2723-456f-b501-3cea91b117d2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:56.744457 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6734cad-2723-456f-b501-3cea91b117d2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:56.744975 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6734cad-2723-456f-b501-3cea91b117d2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:56.976172 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-713dbeab-755f-41d3-9bef-9d875d8eeb77 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:56.990415 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-713dbeab-755f-41d3-9bef-9d875d8eeb77 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.715971 Dec 15 14:03:56.992536 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 54/114] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:56 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:57.015404 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-ce3431a8-744d-4078-ae5d-e34813715819 req-fba8d80d-35d9-414c-a207-b137030ce976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08832229-b545-4a06-a332-54ab9a72bacd", "tag": "96478e00-8427-434c-8484-2d9c25c7698e"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:03:57.022824 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:03:57.022824 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:03:57.046578 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-ce3431a8-744d-4078-ae5d-e34813715819 req-fba8d80d-35d9-414c-a207-b137030ce976 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:57.050053 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-ce3431a8-744d-4078-ae5d-e34813715819 req-fba8d80d-35d9-414c-a207-b137030ce976 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:57.095543 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-ce3431a8-744d-4078-ae5d-e34813715819 req-fba8d80d-35d9-414c-a207-b137030ce976 service nova] Creating event network-changed:96478e00-8427-434c-8484-2d9c25c7698e for instance 08832229-b545-4a06-a332-54ab9a72bacd on hv-cinder-82182 Dec 15 14:03:57.103900 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-ce3431a8-744d-4078-ae5d-e34813715819 req-fba8d80d-35d9-414c-a207-b137030ce976 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105834 Dec 15 14:03:57.103900 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 55/115] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:03:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:57.112462 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9ea2a3b8-35fe-4b5f-af0a-892bb534a013 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:57.113167 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9ea2a3b8-35fe-4b5f-af0a-892bb534a013 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:57.146902 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ea2a3b8-35fe-4b5f-af0a-892bb534a013 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:57.148481 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ea2a3b8-35fe-4b5f-af0a-892bb534a013 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:57.149517 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ea2a3b8-35fe-4b5f-af0a-892bb534a013 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:57.150626 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ea2a3b8-35fe-4b5f-af0a-892bb534a013 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:57.342760 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b6734cad-2723-456f-b501-3cea91b117d2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:57.351082 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b6734cad-2723-456f-b501-3cea91b117d2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.638224 Dec 15 14:03:57.358151 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 61/116] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:56 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:57.365728 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3cb51e3d-3b48-440d-a499-396a6ebfc450 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:57.366514 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3cb51e3d-3b48-440d-a499-396a6ebfc450 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:57.378502 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3cb51e3d-3b48-440d-a499-396a6ebfc450 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:57.382311 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3cb51e3d-3b48-440d-a499-396a6ebfc450 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:57.383545 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3cb51e3d-3b48-440d-a499-396a6ebfc450 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:57.384130 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3cb51e3d-3b48-440d-a499-396a6ebfc450 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:57.663088 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9ea2a3b8-35fe-4b5f-af0a-892bb534a013 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:57.664067 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3cb51e3d-3b48-440d-a499-396a6ebfc450 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:57.673445 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3cb51e3d-3b48-440d-a499-396a6ebfc450 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:57.675391 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3cb51e3d-3b48-440d-a499-396a6ebfc450 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:57.676508 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3cb51e3d-3b48-440d-a499-396a6ebfc450 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.317049 Dec 15 14:03:57.686567 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 62/117] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:03:57 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:03:57.686809 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9ea2a3b8-35fe-4b5f-af0a-892bb534a013 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.574707 Dec 15 14:03:57.686809 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 56/118] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:57 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:57.861300 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0ec0a74f-76b8-47b7-9a6a-beb51f7be546 tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] Action: 'create', calling method: .version_select at 0x7faa3c9d1040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-620604286", "metadata": {"Type": "work"}}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:03:57.862955 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0ec0a74f-76b8-47b7-9a6a-beb51f7be546 tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:03:57.863829 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0ec0a74f-76b8-47b7-9a6a-beb51f7be546 tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.185682 Dec 15 14:03:57.864370 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 63/119] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Dec 15 14:03:57 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 187 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 14:03:57.874798 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f78bac68-b846-472d-b20b-c1ccc8d4e0e1 tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] Action: 'create', calling method: .version_select at 0x7faa3ca22ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-695882889", "metadata": {"Type": "work"}}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:03:57.876234 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f78bac68-b846-472d-b20b-c1ccc8d4e0e1 tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:03:57.877033 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f78bac68-b846-472d-b20b-c1ccc8d4e0e1 tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006028 Dec 15 14:03:57.877679 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 57/120] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Dec 15 14:03:57 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 15 14:03:57.886475 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d9f7c6cd-f4e9-4220-bff5-604b2bb60f74 tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] Action: 'create', calling method: .version_select at 0x7faa3c9bed30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1757572761", "metadata": {"Type": "work"}}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:03:57.887743 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d9f7c6cd-f4e9-4220-bff5-604b2bb60f74 tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:03:57.888478 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d9f7c6cd-f4e9-4220-bff5-604b2bb60f74 tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005682 Dec 15 14:03:57.889130 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 64/121] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Dec 15 14:03:57 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 14:03:57.897871 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4020799c-0ad3-4fb0-855d-f837d10d69be tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] Calling method '.version_select at 0x7faa3ca6c790>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:57.932377 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-4020799c-0ad3-4fb0-855d-f837d10d69be tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] HTTP exception thrown: Volume tempest-invalid-1695012645 could not be found. Dec 15 14:03:57.932963 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4020799c-0ad3-4fb0-855d-f837d10d69be tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] Returning 404 to user: Volume tempest-invalid-1695012645 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:03:57.933856 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4020799c-0ad3-4fb0-855d-f837d10d69be tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1695012645" status: 404 len: 99 microversion: 2.1 time: 0.039621 Dec 15 14:03:57.944699 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 58/122] 10.222.0.42 () {58 vars in 1217 bytes} [Wed Dec 15 14:03:57 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1695012645 => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 15 14:03:57.945371 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8d0c174d-3424-4d33-8921-b304991d5649 tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004629 Dec 15 14:03:57.955651 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d88cc0fc-ed4c-41d5-b085-4549f8fbbac9 tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004019 Dec 15 14:03:57.956209 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 65/123] 10.222.0.42 () {58 vars in 1139 bytes} [Wed Dec 15 14:03:57 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 14:03:57.966382 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4f9f3ed0-613c-4797-9544-fe8228cde6fa tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] Calling method '.version_select at 0x7faa3c9d1940>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:57.966747 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 59/124] 10.222.0.42 () {58 vars in 1136 bytes} [Wed Dec 15 14:03:57 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 14:03:57.999748 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-4f9f3ed0-613c-4797-9544-fe8228cde6fa tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] HTTP exception thrown: Volume 0151d68d-bdc1-4378-9d03-9c5ebcce74fd could not be found. Dec 15 14:03:58.001357 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4f9f3ed0-613c-4797-9544-fe8228cde6fa tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] Returning 404 to user: Volume 0151d68d-bdc1-4378-9d03-9c5ebcce74fd could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:03:58.001357 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4f9f3ed0-613c-4797-9544-fe8228cde6fa tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/0151d68d-bdc1-4378-9d03-9c5ebcce74fd" status: 404 len: 109 microversion: 2.1 time: 0.038736 Dec 15 14:03:58.002202 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 66/125] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Dec 15 14:03:57 2021] DELETE /compute/v2.1/os-volumes/0151d68d-bdc1-4378-9d03-9c5ebcce74fd => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:03:58.011497 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-20505517-e420-4b83-9682-aeaa3292f285 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:58.012479 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-20505517-e420-4b83-9682-aeaa3292f285 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:58.017114 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-177ced7a-d7a7-48ba-8f81-da6735f98fca tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] Calling method '.version_select at 0x7faa3da4d940>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:58.020108 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20505517-e420-4b83-9682-aeaa3292f285 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:58.020865 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20505517-e420-4b83-9682-aeaa3292f285 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:58.022079 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20505517-e420-4b83-9682-aeaa3292f285 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:58.022726 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20505517-e420-4b83-9682-aeaa3292f285 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:58.055297 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-177ced7a-d7a7-48ba-8f81-da6735f98fca tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] HTTP exception thrown: Volume ac4f9e65-e14c-4f24-bc6b-1647c245899b could not be found. Dec 15 14:03:58.056089 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-177ced7a-d7a7-48ba-8f81-da6735f98fca tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] Returning 404 to user: Volume ac4f9e65-e14c-4f24-bc6b-1647c245899b could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:03:58.056956 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-177ced7a-d7a7-48ba-8f81-da6735f98fca tempest-VolumesNegativeTest-866105193 tempest-VolumesNegativeTest-866105193-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/ac4f9e65-e14c-4f24-bc6b-1647c245899b" status: 404 len: 109 microversion: 2.1 time: 0.045826 Dec 15 14:03:58.057559 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 67/126] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:03:58 2021] GET /compute/v2.1/os-volumes/ac4f9e65-e14c-4f24-bc6b-1647c245899b => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:03:58.205726 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-20505517-e420-4b83-9682-aeaa3292f285 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:58.214857 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-20505517-e420-4b83-9682-aeaa3292f285 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.208534 Dec 15 14:03:58.215588 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 60/127] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:58 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:03:58.263683 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-e73b13ac-cb43-4ca3-addc-6a3da5d7dd3d req-58cc3c44-962e-4b88-84ae-6bc483bd30c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc65306-f419-4eac-97a2-407c5d6744da", "tag": "7989001b-405b-4c40-b4ff-1aeb457e4e50"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:03:58.265170 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:03:58.265170 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:03:58.272301 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-e73b13ac-cb43-4ca3-addc-6a3da5d7dd3d req-58cc3c44-962e-4b88-84ae-6bc483bd30c3 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:58.272732 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-e73b13ac-cb43-4ca3-addc-6a3da5d7dd3d req-58cc3c44-962e-4b88-84ae-6bc483bd30c3 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:58.284314 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-e73b13ac-cb43-4ca3-addc-6a3da5d7dd3d req-58cc3c44-962e-4b88-84ae-6bc483bd30c3 service nova] Creating event network-changed:7989001b-405b-4c40-b4ff-1aeb457e4e50 for instance fcc65306-f419-4eac-97a2-407c5d6744da on hv-cinder-82182 Dec 15 14:03:58.289633 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-e73b13ac-cb43-4ca3-addc-6a3da5d7dd3d req-58cc3c44-962e-4b88-84ae-6bc483bd30c3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029418 Dec 15 14:03:58.290563 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 68/128] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:03:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:03:58.375852 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b954acd8-a2b9-475c-93c5-e604d094846e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:58.376648 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b954acd8-a2b9-475c-93c5-e604d094846e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:58.384493 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b954acd8-a2b9-475c-93c5-e604d094846e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:58.385174 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b954acd8-a2b9-475c-93c5-e604d094846e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:58.386182 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b954acd8-a2b9-475c-93c5-e604d094846e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:58.386617 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b954acd8-a2b9-475c-93c5-e604d094846e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:58.697477 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-14ffce2d-68cb-40e8-bb56-18ae62fd194d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:58.698212 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-14ffce2d-68cb-40e8-bb56-18ae62fd194d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:58.714183 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-14ffce2d-68cb-40e8-bb56-18ae62fd194d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:58.714618 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-14ffce2d-68cb-40e8-bb56-18ae62fd194d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:58.715827 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-14ffce2d-68cb-40e8-bb56-18ae62fd194d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:58.716479 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-14ffce2d-68cb-40e8-bb56-18ae62fd194d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:58.803028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b954acd8-a2b9-475c-93c5-e604d094846e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:58.811209 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b954acd8-a2b9-475c-93c5-e604d094846e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.440629 Dec 15 14:03:58.812043 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 61/129] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:58 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:58.816672 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b28e0572-ff1c-4c49-bb32-a90dc1b5b92b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:58.817820 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b28e0572-ff1c-4c49-bb32-a90dc1b5b92b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:58.824348 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b28e0572-ff1c-4c49-bb32-a90dc1b5b92b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:58.825108 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b28e0572-ff1c-4c49-bb32-a90dc1b5b92b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:58.825951 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b28e0572-ff1c-4c49-bb32-a90dc1b5b92b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:58.826397 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b28e0572-ff1c-4c49-bb32-a90dc1b5b92b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:59.100817 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-14ffce2d-68cb-40e8-bb56-18ae62fd194d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:59.113414 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-14ffce2d-68cb-40e8-bb56-18ae62fd194d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:59.116106 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-14ffce2d-68cb-40e8-bb56-18ae62fd194d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:59.117653 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-14ffce2d-68cb-40e8-bb56-18ae62fd194d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.424681 Dec 15 14:03:59.118528 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 69/130] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:03:58 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:03:59.168196 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b28e0572-ff1c-4c49-bb32-a90dc1b5b92b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:59.176873 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b28e0572-ff1c-4c49-bb32-a90dc1b5b92b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.363552 Dec 15 14:03:59.177831 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 62/131] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:58 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:59.232605 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-025f9fd5-fba1-4be9-9633-3f141d5df250 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:59.233206 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-025f9fd5-fba1-4be9-9633-3f141d5df250 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:59.243208 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-025f9fd5-fba1-4be9-9633-3f141d5df250 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:59.243647 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-025f9fd5-fba1-4be9-9633-3f141d5df250 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:59.244440 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-025f9fd5-fba1-4be9-9633-3f141d5df250 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:59.244868 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-025f9fd5-fba1-4be9-9633-3f141d5df250 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:59.388857 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-025f9fd5-fba1-4be9-9633-3f141d5df250 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:59.396770 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-025f9fd5-fba1-4be9-9633-3f141d5df250 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.167993 Dec 15 14:03:59.397460 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 70/132] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:59 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:03:59.828323 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-599a88fe-5a06-4943-b31b-cd23bc5aa9e1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:03:59.829171 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-599a88fe-5a06-4943-b31b-cd23bc5aa9e1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:03:59.835651 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-599a88fe-5a06-4943-b31b-cd23bc5aa9e1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:59.836311 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-599a88fe-5a06-4943-b31b-cd23bc5aa9e1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:59.837821 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-599a88fe-5a06-4943-b31b-cd23bc5aa9e1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:03:59.838428 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-599a88fe-5a06-4943-b31b-cd23bc5aa9e1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:03:59.989761 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-599a88fe-5a06-4943-b31b-cd23bc5aa9e1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:03:59.997370 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-599a88fe-5a06-4943-b31b-cd23bc5aa9e1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.172884 Dec 15 14:04:00.006807 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 63/133] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:03:59 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:00.139540 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c060a6c6-5215-4e29-a566-6f658974cb88 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:00.140761 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c060a6c6-5215-4e29-a566-6f658974cb88 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:00.148214 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c060a6c6-5215-4e29-a566-6f658974cb88 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:00.148636 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c060a6c6-5215-4e29-a566-6f658974cb88 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:00.149711 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c060a6c6-5215-4e29-a566-6f658974cb88 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:00.150147 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c060a6c6-5215-4e29-a566-6f658974cb88 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:00.194385 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6d98dd72-cac5-48a6-a248-0bff5aaa42a4 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:00.195118 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6d98dd72-cac5-48a6-a248-0bff5aaa42a4 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:00.201234 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d98dd72-cac5-48a6-a248-0bff5aaa42a4 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:00.201709 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d98dd72-cac5-48a6-a248-0bff5aaa42a4 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:00.202498 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d98dd72-cac5-48a6-a248-0bff5aaa42a4 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:00.203227 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d98dd72-cac5-48a6-a248-0bff5aaa42a4 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:00.318939 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c060a6c6-5215-4e29-a566-6f658974cb88 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:00.327239 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c060a6c6-5215-4e29-a566-6f658974cb88 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:00.328923 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c060a6c6-5215-4e29-a566-6f658974cb88 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:00.330154 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c060a6c6-5215-4e29-a566-6f658974cb88 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.194392 Dec 15 14:04:00.330797 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 71/134] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:00 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:00.387324 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6d98dd72-cac5-48a6-a248-0bff5aaa42a4 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:00.395471 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6d98dd72-cac5-48a6-a248-0bff5aaa42a4 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.204919 Dec 15 14:04:00.396349 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 64/135] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:00 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:00.414546 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6f96747c-7f3a-439b-9a6d-d434a537bdb0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:00.415147 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6f96747c-7f3a-439b-9a6d-d434a537bdb0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:00.421236 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f96747c-7f3a-439b-9a6d-d434a537bdb0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:00.421889 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f96747c-7f3a-439b-9a6d-d434a537bdb0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:00.422742 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f96747c-7f3a-439b-9a6d-d434a537bdb0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:00.423245 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f96747c-7f3a-439b-9a6d-d434a537bdb0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:00.567275 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6f96747c-7f3a-439b-9a6d-d434a537bdb0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:00.574835 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6f96747c-7f3a-439b-9a6d-d434a537bdb0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.163979 Dec 15 14:04:00.580794 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 72/136] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:00 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:01.014222 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dd9c9f36-ff3f-44c6-b41c-fbfc2eb1a4dd tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:01.014814 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dd9c9f36-ff3f-44c6-b41c-fbfc2eb1a4dd tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:01.021379 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dd9c9f36-ff3f-44c6-b41c-fbfc2eb1a4dd tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:01.021939 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dd9c9f36-ff3f-44c6-b41c-fbfc2eb1a4dd tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:01.022814 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dd9c9f36-ff3f-44c6-b41c-fbfc2eb1a4dd tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:01.023314 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dd9c9f36-ff3f-44c6-b41c-fbfc2eb1a4dd tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:01.262260 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dd9c9f36-ff3f-44c6-b41c-fbfc2eb1a4dd tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:01.272484 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dd9c9f36-ff3f-44c6-b41c-fbfc2eb1a4dd tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.261869 Dec 15 14:04:01.273243 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 65/137] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:01 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:01.349073 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7955aab0-8f69-4db8-9f90-145b8cf094e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:01.349705 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7955aab0-8f69-4db8-9f90-145b8cf094e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:01.356219 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7955aab0-8f69-4db8-9f90-145b8cf094e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:01.356670 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7955aab0-8f69-4db8-9f90-145b8cf094e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:01.357577 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7955aab0-8f69-4db8-9f90-145b8cf094e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:01.358068 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7955aab0-8f69-4db8-9f90-145b8cf094e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:01.413548 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-48b5a8ad-4018-4d64-8d8e-81c441841c9e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:01.414198 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-48b5a8ad-4018-4d64-8d8e-81c441841c9e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:01.420625 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48b5a8ad-4018-4d64-8d8e-81c441841c9e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:01.421199 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48b5a8ad-4018-4d64-8d8e-81c441841c9e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:01.422623 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48b5a8ad-4018-4d64-8d8e-81c441841c9e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:01.423061 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48b5a8ad-4018-4d64-8d8e-81c441841c9e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:01.775936 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7955aab0-8f69-4db8-9f90-145b8cf094e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:01.787739 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7955aab0-8f69-4db8-9f90-145b8cf094e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:01.789667 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7955aab0-8f69-4db8-9f90-145b8cf094e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:01.791042 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7955aab0-8f69-4db8-9f90-145b8cf094e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.446054 Dec 15 14:04:01.791821 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 73/138] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:01 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:01.796619 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c0e608ea-d17a-4c3b-9c53-e32da95f2023 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:01.797353 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c0e608ea-d17a-4c3b-9c53-e32da95f2023 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:01.806577 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0e608ea-d17a-4c3b-9c53-e32da95f2023 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:01.807325 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0e608ea-d17a-4c3b-9c53-e32da95f2023 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:01.810018 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0e608ea-d17a-4c3b-9c53-e32da95f2023 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:01.810800 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0e608ea-d17a-4c3b-9c53-e32da95f2023 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:01.872366 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-48b5a8ad-4018-4d64-8d8e-81c441841c9e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:01.881862 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-48b5a8ad-4018-4d64-8d8e-81c441841c9e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.472825 Dec 15 14:04:01.882506 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 66/139] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:01 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:01.987643 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c0e608ea-d17a-4c3b-9c53-e32da95f2023 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:01.995222 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c0e608ea-d17a-4c3b-9c53-e32da95f2023 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.202084 Dec 15 14:04:01.995796 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 74/140] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:01 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:02.291134 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5486e9e3-e338-40c0-ab39-6d502d201808 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:02.292854 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5486e9e3-e338-40c0-ab39-6d502d201808 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:02.312197 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5486e9e3-e338-40c0-ab39-6d502d201808 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:02.314753 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5486e9e3-e338-40c0-ab39-6d502d201808 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:02.316067 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5486e9e3-e338-40c0-ab39-6d502d201808 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:02.316911 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5486e9e3-e338-40c0-ab39-6d502d201808 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:02.572598 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5486e9e3-e338-40c0-ab39-6d502d201808 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:02.581275 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5486e9e3-e338-40c0-ab39-6d502d201808 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.294236 Dec 15 14:04:02.581899 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 67/141] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:02 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:02.808883 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-298b1667-c97f-4b12-ae55-95482ddb2594 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:02.810063 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-298b1667-c97f-4b12-ae55-95482ddb2594 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:02.818478 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-298b1667-c97f-4b12-ae55-95482ddb2594 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:02.818923 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-298b1667-c97f-4b12-ae55-95482ddb2594 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:02.819879 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-298b1667-c97f-4b12-ae55-95482ddb2594 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:02.820510 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-298b1667-c97f-4b12-ae55-95482ddb2594 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:02.902430 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-90639a78-1f85-4a62-98e6-942614507af9 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:02.903764 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-90639a78-1f85-4a62-98e6-942614507af9 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:02.914717 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90639a78-1f85-4a62-98e6-942614507af9 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:02.915497 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90639a78-1f85-4a62-98e6-942614507af9 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:02.916472 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90639a78-1f85-4a62-98e6-942614507af9 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:02.916964 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90639a78-1f85-4a62-98e6-942614507af9 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:02.983065 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-298b1667-c97f-4b12-ae55-95482ddb2594 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:02.993709 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-298b1667-c97f-4b12-ae55-95482ddb2594 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:02.997854 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-298b1667-c97f-4b12-ae55-95482ddb2594 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:02.999326 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-298b1667-c97f-4b12-ae55-95482ddb2594 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.194206 Dec 15 14:04:03.011343 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 75/142] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:02 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:03.018203 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1c78b59c-f120-41ed-8ed9-3c43548083a3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:03.019050 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1c78b59c-f120-41ed-8ed9-3c43548083a3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:03.026875 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c78b59c-f120-41ed-8ed9-3c43548083a3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:03.027408 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c78b59c-f120-41ed-8ed9-3c43548083a3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:03.028278 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c78b59c-f120-41ed-8ed9-3c43548083a3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:03.028720 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c78b59c-f120-41ed-8ed9-3c43548083a3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:03.119516 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-90639a78-1f85-4a62-98e6-942614507af9 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:03.131607 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-90639a78-1f85-4a62-98e6-942614507af9 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.234522 Dec 15 14:04:03.141131 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 68/143] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:02 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:03.226187 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1c78b59c-f120-41ed-8ed9-3c43548083a3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:03.233682 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1c78b59c-f120-41ed-8ed9-3c43548083a3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.220890 Dec 15 14:04:03.234312 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 76/144] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:03 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:03.331638 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-739abc31-c9c4-47d9-ad96-7c17807e14ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1181959859", "imageRef": "9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7", "flavorRef": "452", "networks": [{"uuid": "4bd66510-5412-4b6b-8ec9-b734ef6130ab"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:03.387298 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-739abc31-c9c4-47d9-ad96-7c17807e14ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] validate_networks() for [('4bd66510-5412-4b6b-8ec9-b734ef6130ab', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:04:03.599053 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ec5bc2e7-8955-4e75-8dce-5cec163a8a84 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:03.599842 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ec5bc2e7-8955-4e75-8dce-5cec163a8a84 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:03.606592 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec5bc2e7-8955-4e75-8dce-5cec163a8a84 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:03.607111 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec5bc2e7-8955-4e75-8dce-5cec163a8a84 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:03.607966 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec5bc2e7-8955-4e75-8dce-5cec163a8a84 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:03.608472 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec5bc2e7-8955-4e75-8dce-5cec163a8a84 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:04.167907 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ec5bc2e7-8955-4e75-8dce-5cec163a8a84 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:04.175623 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ec5bc2e7-8955-4e75-8dce-5cec163a8a84 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.581012 Dec 15 14:04:04.176255 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 77/145] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:03 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:04.180503 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b12bcdba-f4d0-412c-926f-2fbcd914e942 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:04.181074 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b12bcdba-f4d0-412c-926f-2fbcd914e942 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:04.187527 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b12bcdba-f4d0-412c-926f-2fbcd914e942 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:04.188248 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b12bcdba-f4d0-412c-926f-2fbcd914e942 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:04.189636 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b12bcdba-f4d0-412c-926f-2fbcd914e942 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:04.190160 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b12bcdba-f4d0-412c-926f-2fbcd914e942 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:04.204785 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-739abc31-c9c4-47d9-ad96-7c17807e14ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:04:04.205395 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-739abc31-c9c4-47d9-ad96-7c17807e14ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:04:04.206272 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-739abc31-c9c4-47d9-ad96-7c17807e14ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:04:04.206816 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-739abc31-c9c4-47d9-ad96-7c17807e14ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:04:04.207216 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-739abc31-c9c4-47d9-ad96-7c17807e14ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:04:04.221440 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-739abc31-c9c4-47d9-ad96-7c17807e14ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:04.221999 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-739abc31-c9c4-47d9-ad96-7c17807e14ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:04.222831 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-739abc31-c9c4-47d9-ad96-7c17807e14ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:04.223433 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-739abc31-c9c4-47d9-ad96-7c17807e14ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:04.242433 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-739abc31-c9c4-47d9-ad96-7c17807e14ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Getting quotas for project 5eaf014646924970b2c59d6a4b7d7274. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:04:04.247859 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-739abc31-c9c4-47d9-ad96-7c17807e14ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Getting quotas for user 3b87ff00a9da48e5aa3636790bce3772 and project 5eaf014646924970b2c59d6a4b7d7274. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:04:04.261016 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-739abc31-c9c4-47d9-ad96-7c17807e14ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:04:04.263853 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-739abc31-c9c4-47d9-ad96-7c17807e14ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:04:04.350780 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-739abc31-c9c4-47d9-ad96-7c17807e14ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.022875 Dec 15 14:04:04.351927 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 69/146] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Dec 15 14:04:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:04:04.357099 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b12bcdba-f4d0-412c-926f-2fbcd914e942 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:04.357863 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-90729677-3dc7-4b72-a820-bbc9a9ea29fa tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:04.358749 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-90729677-3dc7-4b72-a820-bbc9a9ea29fa tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:04.369087 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90729677-3dc7-4b72-a820-bbc9a9ea29fa tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:04.369652 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90729677-3dc7-4b72-a820-bbc9a9ea29fa tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:04.371060 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90729677-3dc7-4b72-a820-bbc9a9ea29fa tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:04.371804 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90729677-3dc7-4b72-a820-bbc9a9ea29fa tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:04.382231 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b12bcdba-f4d0-412c-926f-2fbcd914e942 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:04.385451 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b12bcdba-f4d0-412c-926f-2fbcd914e942 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:04.386676 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b12bcdba-f4d0-412c-926f-2fbcd914e942 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.209517 Dec 15 14:04:04.387818 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 78/147] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:04 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:04.406808 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-adaf08c6-3e42-423a-a74a-d8605b846768 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:04.414590 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-adaf08c6-3e42-423a-a74a-d8605b846768 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:04.421187 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-adaf08c6-3e42-423a-a74a-d8605b846768 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:04.422812 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-adaf08c6-3e42-423a-a74a-d8605b846768 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:04.423869 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-adaf08c6-3e42-423a-a74a-d8605b846768 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:04.424535 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-adaf08c6-3e42-423a-a74a-d8605b846768 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:04.577120 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-90729677-3dc7-4b72-a820-bbc9a9ea29fa tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:04.592615 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-90729677-3dc7-4b72-a820-bbc9a9ea29fa tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.239528 Dec 15 14:04:04.593787 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 70/148] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:04 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:04.598812 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6ba9c17a-dba8-4b4b-9164-e4ff7f8c1190 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:04.599456 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6ba9c17a-dba8-4b4b-9164-e4ff7f8c1190 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:04.664181 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6ba9c17a-dba8-4b4b-9164-e4ff7f8c1190 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:04.666627 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-adaf08c6-3e42-423a-a74a-d8605b846768 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:04.677058 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6ba9c17a-dba8-4b4b-9164-e4ff7f8c1190 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1219 microversion: 2.1 time: 0.081723 Dec 15 14:04:04.677783 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 71/149] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:04 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:04.681273 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-adaf08c6-3e42-423a-a74a-d8605b846768 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.292268 Dec 15 14:04:04.681867 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 79/150] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:04 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:05.192623 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-aadb8ff2-e2d4-448b-aac8-da15a8d5a790 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:05.193546 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-aadb8ff2-e2d4-448b-aac8-da15a8d5a790 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:05.200769 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aadb8ff2-e2d4-448b-aac8-da15a8d5a790 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:05.201806 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aadb8ff2-e2d4-448b-aac8-da15a8d5a790 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:05.203320 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aadb8ff2-e2d4-448b-aac8-da15a8d5a790 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:05.204194 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aadb8ff2-e2d4-448b-aac8-da15a8d5a790 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:05.372929 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-aadb8ff2-e2d4-448b-aac8-da15a8d5a790 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:05.380990 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-aadb8ff2-e2d4-448b-aac8-da15a8d5a790 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.192160 Dec 15 14:04:05.381577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 72/151] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:05 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:05.405204 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b640fafa-e600-4524-a62c-b0ca4a016fbe tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:05.405920 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b640fafa-e600-4524-a62c-b0ca4a016fbe tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:05.419106 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b640fafa-e600-4524-a62c-b0ca4a016fbe tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:05.419560 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b640fafa-e600-4524-a62c-b0ca4a016fbe tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:05.420342 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b640fafa-e600-4524-a62c-b0ca4a016fbe tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:05.420771 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b640fafa-e600-4524-a62c-b0ca4a016fbe tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:05.578298 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-9c3b6be0-9450-441f-bb42-5b1b0f4d5872 req-ef5e1690-da78-41d3-a9ac-4419406873b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f68da2b-2ed8-4892-85a6-1612edd7b6fc", "name": "network-vif-plugged", "status": "completed", "tag": "223697b4-2610-4672-9cd7-955d6898e0bb"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:05.580389 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:04:05.580389 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:04:05.588284 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-9c3b6be0-9450-441f-bb42-5b1b0f4d5872 req-ef5e1690-da78-41d3-a9ac-4419406873b0 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:05.588935 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-9c3b6be0-9450-441f-bb42-5b1b0f4d5872 req-ef5e1690-da78-41d3-a9ac-4419406873b0 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:05.601997 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b640fafa-e600-4524-a62c-b0ca4a016fbe tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:05.604758 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-9c3b6be0-9450-441f-bb42-5b1b0f4d5872 req-ef5e1690-da78-41d3-a9ac-4419406873b0 service nova] Creating event network-vif-plugged:223697b4-2610-4672-9cd7-955d6898e0bb for instance 3f68da2b-2ed8-4892-85a6-1612edd7b6fc on hv-cinder-82182 Dec 15 14:04:05.610700 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-9c3b6be0-9450-441f-bb42-5b1b0f4d5872 req-ef5e1690-da78-41d3-a9ac-4419406873b0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140070 Dec 15 14:04:05.611717 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 73/152] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:04:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:04:05.615522 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b640fafa-e600-4524-a62c-b0ca4a016fbe tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:05.616646 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4b435e4c-6553-4d90-bca8-47afa8a3bd60 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:05.617356 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4b435e4c-6553-4d90-bca8-47afa8a3bd60 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:05.619166 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b640fafa-e600-4524-a62c-b0ca4a016fbe tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:05.620959 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b640fafa-e600-4524-a62c-b0ca4a016fbe tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.219548 Dec 15 14:04:05.631925 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 80/153] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:05 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:05.632387 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4b435e4c-6553-4d90-bca8-47afa8a3bd60 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:05.632387 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4b435e4c-6553-4d90-bca8-47afa8a3bd60 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:05.632387 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4b435e4c-6553-4d90-bca8-47afa8a3bd60 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:05.632387 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4b435e4c-6553-4d90-bca8-47afa8a3bd60 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:05.697948 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9c8347b5-ed2b-4eec-b7fb-a30b6400efbb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:05.698819 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9c8347b5-ed2b-4eec-b7fb-a30b6400efbb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:05.705446 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c8347b5-ed2b-4eec-b7fb-a30b6400efbb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:05.706171 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c8347b5-ed2b-4eec-b7fb-a30b6400efbb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:05.707128 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c8347b5-ed2b-4eec-b7fb-a30b6400efbb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:05.707712 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c8347b5-ed2b-4eec-b7fb-a30b6400efbb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:05.783673 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9c8347b5-ed2b-4eec-b7fb-a30b6400efbb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:05.793265 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9c8347b5-ed2b-4eec-b7fb-a30b6400efbb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1223 microversion: 2.1 time: 0.102509 Dec 15 14:04:05.794565 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 81/154] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:05 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:05.801033 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-21ce38b4-6a7f-43eb-b7cd-c1332842a24f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:05.801651 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-21ce38b4-6a7f-43eb-b7cd-c1332842a24f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:05.808594 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21ce38b4-6a7f-43eb-b7cd-c1332842a24f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:05.809355 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21ce38b4-6a7f-43eb-b7cd-c1332842a24f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:05.810421 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21ce38b4-6a7f-43eb-b7cd-c1332842a24f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:05.811020 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21ce38b4-6a7f-43eb-b7cd-c1332842a24f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:05.862495 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4b435e4c-6553-4d90-bca8-47afa8a3bd60 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:05.874590 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4b435e4c-6553-4d90-bca8-47afa8a3bd60 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.261581 Dec 15 14:04:05.875822 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 74/155] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:05 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:05.961129 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-21ce38b4-6a7f-43eb-b7cd-c1332842a24f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:05.969351 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-21ce38b4-6a7f-43eb-b7cd-c1332842a24f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.172722 Dec 15 14:04:05.969952 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 82/156] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:05 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:06.402482 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9909119b-7260-4c49-be01-1716079f8a3c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:06.403522 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9909119b-7260-4c49-be01-1716079f8a3c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:06.413821 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9909119b-7260-4c49-be01-1716079f8a3c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:06.414451 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9909119b-7260-4c49-be01-1716079f8a3c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:06.415830 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9909119b-7260-4c49-be01-1716079f8a3c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:06.416590 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9909119b-7260-4c49-be01-1716079f8a3c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:06.565450 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9909119b-7260-4c49-be01-1716079f8a3c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:06.577083 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9909119b-7260-4c49-be01-1716079f8a3c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.181405 Dec 15 14:04:06.577815 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 75/157] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:06 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:06.639771 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ad119ecc-5ec7-4867-884c-9c04cf7c808d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:06.640815 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ad119ecc-5ec7-4867-884c-9c04cf7c808d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:06.647471 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad119ecc-5ec7-4867-884c-9c04cf7c808d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:06.647914 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad119ecc-5ec7-4867-884c-9c04cf7c808d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:06.648692 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad119ecc-5ec7-4867-884c-9c04cf7c808d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:06.649124 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad119ecc-5ec7-4867-884c-9c04cf7c808d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:06.783702 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ad119ecc-5ec7-4867-884c-9c04cf7c808d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:06.792181 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ad119ecc-5ec7-4867-884c-9c04cf7c808d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:06.793656 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ad119ecc-5ec7-4867-884c-9c04cf7c808d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:06.794824 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ad119ecc-5ec7-4867-884c-9c04cf7c808d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.158839 Dec 15 14:04:06.795391 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 83/158] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:06 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:06.813117 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-913f22a8-0afa-4114-b31d-34645a0cc587 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:06.813785 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-913f22a8-0afa-4114-b31d-34645a0cc587 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:06.820167 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-913f22a8-0afa-4114-b31d-34645a0cc587 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:06.820620 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-913f22a8-0afa-4114-b31d-34645a0cc587 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:06.821400 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-913f22a8-0afa-4114-b31d-34645a0cc587 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:06.821875 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-913f22a8-0afa-4114-b31d-34645a0cc587 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:06.882168 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-913f22a8-0afa-4114-b31d-34645a0cc587 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:06.890683 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-913f22a8-0afa-4114-b31d-34645a0cc587 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1223 microversion: 2.1 time: 0.082623 Dec 15 14:04:06.890982 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 76/159] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:06 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:06.892074 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8c245212-d018-4f1b-aca0-35ff738f7d33 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:06.892684 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8c245212-d018-4f1b-aca0-35ff738f7d33 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:06.898726 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c245212-d018-4f1b-aca0-35ff738f7d33 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:06.899165 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c245212-d018-4f1b-aca0-35ff738f7d33 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:06.899925 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c245212-d018-4f1b-aca0-35ff738f7d33 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:06.900349 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c245212-d018-4f1b-aca0-35ff738f7d33 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:06.987434 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d5661cd5-18bf-436f-b4c9-c077ad01e31e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:06.988047 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d5661cd5-18bf-436f-b4c9-c077ad01e31e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:06.994656 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5661cd5-18bf-436f-b4c9-c077ad01e31e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:06.995114 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5661cd5-18bf-436f-b4c9-c077ad01e31e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:06.995900 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5661cd5-18bf-436f-b4c9-c077ad01e31e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:06.996334 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5661cd5-18bf-436f-b4c9-c077ad01e31e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:07.054274 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8c245212-d018-4f1b-aca0-35ff738f7d33 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:07.061774 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8c245212-d018-4f1b-aca0-35ff738f7d33 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.173431 Dec 15 14:04:07.062588 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 84/160] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:06 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:07.149551 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d5661cd5-18bf-436f-b4c9-c077ad01e31e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:07.161660 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d5661cd5-18bf-436f-b4c9-c077ad01e31e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.178022 Dec 15 14:04:07.162449 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 77/161] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:06 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:07.596062 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-89fd9754-b050-42a7-ab8f-52177305fff9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:07.596672 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-89fd9754-b050-42a7-ab8f-52177305fff9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:07.603057 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89fd9754-b050-42a7-ab8f-52177305fff9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:07.603584 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89fd9754-b050-42a7-ab8f-52177305fff9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:07.604272 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89fd9754-b050-42a7-ab8f-52177305fff9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:07.604717 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89fd9754-b050-42a7-ab8f-52177305fff9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:07.753739 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-89fd9754-b050-42a7-ab8f-52177305fff9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:07.761587 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-89fd9754-b050-42a7-ab8f-52177305fff9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.170722 Dec 15 14:04:07.762267 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 85/162] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:07 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:07.814957 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ce699fa4-5802-4184-9ebe-54a631d833b9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:07.815830 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ce699fa4-5802-4184-9ebe-54a631d833b9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:07.822443 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce699fa4-5802-4184-9ebe-54a631d833b9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:07.822890 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce699fa4-5802-4184-9ebe-54a631d833b9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:07.823663 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce699fa4-5802-4184-9ebe-54a631d833b9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:07.824096 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce699fa4-5802-4184-9ebe-54a631d833b9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:07.907763 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-30e82916-36ff-4a28-a916-f37aead00ccb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:07.908509 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-30e82916-36ff-4a28-a916-f37aead00ccb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:07.916105 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30e82916-36ff-4a28-a916-f37aead00ccb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:07.916780 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30e82916-36ff-4a28-a916-f37aead00ccb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:07.918060 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30e82916-36ff-4a28-a916-f37aead00ccb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:07.918585 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30e82916-36ff-4a28-a916-f37aead00ccb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:07.975550 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ce699fa4-5802-4184-9ebe-54a631d833b9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:07.984559 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ce699fa4-5802-4184-9ebe-54a631d833b9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:07.986352 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ce699fa4-5802-4184-9ebe-54a631d833b9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:07.987590 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ce699fa4-5802-4184-9ebe-54a631d833b9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.177329 Dec 15 14:04:07.988159 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 78/163] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:07 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:07.992372 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-30e82916-36ff-4a28-a916-f37aead00ccb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:08.001175 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-30e82916-36ff-4a28-a916-f37aead00ccb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1271 microversion: 2.1 time: 0.097144 Dec 15 14:04:08.001822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 86/164] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:07 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:08.078858 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-97a8f99b-3d0a-4395-adde-2af91657dbf1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:08.079490 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-97a8f99b-3d0a-4395-adde-2af91657dbf1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:08.086377 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-97a8f99b-3d0a-4395-adde-2af91657dbf1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:08.086822 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-97a8f99b-3d0a-4395-adde-2af91657dbf1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:08.087629 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-97a8f99b-3d0a-4395-adde-2af91657dbf1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:08.088056 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-97a8f99b-3d0a-4395-adde-2af91657dbf1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:08.181940 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-474043b7-51ff-4d14-b74e-545872362fdf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:08.182543 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-474043b7-51ff-4d14-b74e-545872362fdf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:08.190521 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-474043b7-51ff-4d14-b74e-545872362fdf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:08.190972 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-474043b7-51ff-4d14-b74e-545872362fdf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:08.191753 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-474043b7-51ff-4d14-b74e-545872362fdf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:08.192180 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-474043b7-51ff-4d14-b74e-545872362fdf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:08.227849 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-97a8f99b-3d0a-4395-adde-2af91657dbf1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:08.235821 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-97a8f99b-3d0a-4395-adde-2af91657dbf1 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.160738 Dec 15 14:04:08.236635 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 79/165] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:08 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:08.330132 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-474043b7-51ff-4d14-b74e-545872362fdf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:08.338212 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-474043b7-51ff-4d14-b74e-545872362fdf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.159832 Dec 15 14:04:08.338783 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 87/166] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:08 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:08.778376 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d773f847-a628-48f1-a0a5-f905327f3dbc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:08.779079 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d773f847-a628-48f1-a0a5-f905327f3dbc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:08.786563 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d773f847-a628-48f1-a0a5-f905327f3dbc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:08.787075 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d773f847-a628-48f1-a0a5-f905327f3dbc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:08.787855 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d773f847-a628-48f1-a0a5-f905327f3dbc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:08.788281 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d773f847-a628-48f1-a0a5-f905327f3dbc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:08.924904 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d773f847-a628-48f1-a0a5-f905327f3dbc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:08.933069 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d773f847-a628-48f1-a0a5-f905327f3dbc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.158395 Dec 15 14:04:08.933654 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 80/167] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:08 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:09.010173 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-39c1454a-de4f-426a-9bf4-1af2e6873755 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:09.011177 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-39c1454a-de4f-426a-9bf4-1af2e6873755 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:09.021602 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-39c1454a-de4f-426a-9bf4-1af2e6873755 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:09.022521 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-39c1454a-de4f-426a-9bf4-1af2e6873755 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:09.023260 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ff344b7d-6e86-4c1e-86b3-d95c01ba343d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:09.023802 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-39c1454a-de4f-426a-9bf4-1af2e6873755 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:09.024345 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ff344b7d-6e86-4c1e-86b3-d95c01ba343d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:09.024565 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-39c1454a-de4f-426a-9bf4-1af2e6873755 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:09.034823 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ff344b7d-6e86-4c1e-86b3-d95c01ba343d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:09.035391 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ff344b7d-6e86-4c1e-86b3-d95c01ba343d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:09.036181 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ff344b7d-6e86-4c1e-86b3-d95c01ba343d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:09.036615 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ff344b7d-6e86-4c1e-86b3-d95c01ba343d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:09.135959 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ff344b7d-6e86-4c1e-86b3-d95c01ba343d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:09.144314 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ff344b7d-6e86-4c1e-86b3-d95c01ba343d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1271 microversion: 2.1 time: 0.128077 Dec 15 14:04:09.144968 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 81/168] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:09 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1271 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:09.209665 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-39c1454a-de4f-426a-9bf4-1af2e6873755 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:09.222079 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-39c1454a-de4f-426a-9bf4-1af2e6873755 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:09.223597 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-39c1454a-de4f-426a-9bf4-1af2e6873755 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:09.224950 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-39c1454a-de4f-426a-9bf4-1af2e6873755 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.220794 Dec 15 14:04:09.225822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 88/169] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:09 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:09.256607 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6468d229-2317-452e-8ab2-7b196800c3d5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:09.257585 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6468d229-2317-452e-8ab2-7b196800c3d5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:09.267230 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6468d229-2317-452e-8ab2-7b196800c3d5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:09.267972 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6468d229-2317-452e-8ab2-7b196800c3d5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:09.268740 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6468d229-2317-452e-8ab2-7b196800c3d5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:09.269168 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6468d229-2317-452e-8ab2-7b196800c3d5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:09.355622 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-10261930-3d59-4292-89ea-15be929ce1e7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:09.356218 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-10261930-3d59-4292-89ea-15be929ce1e7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:09.365347 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10261930-3d59-4292-89ea-15be929ce1e7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:09.365835 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10261930-3d59-4292-89ea-15be929ce1e7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:09.367291 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10261930-3d59-4292-89ea-15be929ce1e7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:09.367291 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10261930-3d59-4292-89ea-15be929ce1e7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:09.408103 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6468d229-2317-452e-8ab2-7b196800c3d5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:09.416478 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6468d229-2317-452e-8ab2-7b196800c3d5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.165917 Dec 15 14:04:09.417307 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 82/170] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:09 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:09.511941 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-10261930-3d59-4292-89ea-15be929ce1e7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:09.519907 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-10261930-3d59-4292-89ea-15be929ce1e7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.168021 Dec 15 14:04:09.520476 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 89/171] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:09 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:09.953710 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c312afcc-103c-43df-a386-450300308a37 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:09.954732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c312afcc-103c-43df-a386-450300308a37 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:09.961438 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c312afcc-103c-43df-a386-450300308a37 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:09.961912 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c312afcc-103c-43df-a386-450300308a37 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:09.962676 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c312afcc-103c-43df-a386-450300308a37 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:09.963101 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c312afcc-103c-43df-a386-450300308a37 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:10.108585 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c312afcc-103c-43df-a386-450300308a37 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:10.117353 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c312afcc-103c-43df-a386-450300308a37 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.169713 Dec 15 14:04:10.117958 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 83/172] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:09 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:10.162407 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8c5a3adb-45c8-4e13-8314-f86bc3791ae9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:10.162981 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8c5a3adb-45c8-4e13-8314-f86bc3791ae9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:10.169447 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c5a3adb-45c8-4e13-8314-f86bc3791ae9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:10.169896 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c5a3adb-45c8-4e13-8314-f86bc3791ae9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:10.170688 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c5a3adb-45c8-4e13-8314-f86bc3791ae9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:10.171112 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c5a3adb-45c8-4e13-8314-f86bc3791ae9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:10.234593 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8c5a3adb-45c8-4e13-8314-f86bc3791ae9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:10.242769 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8c5a3adb-45c8-4e13-8314-f86bc3791ae9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1271 microversion: 2.1 time: 0.084049 Dec 15 14:04:10.243333 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 90/173] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:10 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:10.245579 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-294462cc-8297-49d4-a5d0-aec969393914 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:10.246203 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-294462cc-8297-49d4-a5d0-aec969393914 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:10.253453 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-294462cc-8297-49d4-a5d0-aec969393914 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:10.253921 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-294462cc-8297-49d4-a5d0-aec969393914 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:10.254698 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-294462cc-8297-49d4-a5d0-aec969393914 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:10.255122 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-294462cc-8297-49d4-a5d0-aec969393914 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:10.404320 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-294462cc-8297-49d4-a5d0-aec969393914 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:10.413035 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-294462cc-8297-49d4-a5d0-aec969393914 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:10.414571 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-294462cc-8297-49d4-a5d0-aec969393914 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:10.415689 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-294462cc-8297-49d4-a5d0-aec969393914 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.173805 Dec 15 14:04:10.416280 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 84/174] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:10 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:10.436456 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-66410bbd-0ce3-4f0e-9e40-fda21bc9ff4f tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:10.437360 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-66410bbd-0ce3-4f0e-9e40-fda21bc9ff4f tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:10.444339 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66410bbd-0ce3-4f0e-9e40-fda21bc9ff4f tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:10.444790 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66410bbd-0ce3-4f0e-9e40-fda21bc9ff4f tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:10.445567 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66410bbd-0ce3-4f0e-9e40-fda21bc9ff4f tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:10.446034 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66410bbd-0ce3-4f0e-9e40-fda21bc9ff4f tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:10.541156 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c261c377-5819-4760-bf7b-11c1eda57ce5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:10.541774 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c261c377-5819-4760-bf7b-11c1eda57ce5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:10.548021 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c261c377-5819-4760-bf7b-11c1eda57ce5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:10.548459 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c261c377-5819-4760-bf7b-11c1eda57ce5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:10.549299 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c261c377-5819-4760-bf7b-11c1eda57ce5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:10.549770 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c261c377-5819-4760-bf7b-11c1eda57ce5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:10.583920 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-66410bbd-0ce3-4f0e-9e40-fda21bc9ff4f tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:10.591634 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-66410bbd-0ce3-4f0e-9e40-fda21bc9ff4f tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.160315 Dec 15 14:04:10.592362 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 91/175] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:10 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:10.710349 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c261c377-5819-4760-bf7b-11c1eda57ce5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:10.718355 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c261c377-5819-4760-bf7b-11c1eda57ce5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.180799 Dec 15 14:04:10.718922 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 85/176] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:10 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:11.137374 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1c2706a5-1929-4d05-8c84-40a350c633b5 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:11.138421 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1c2706a5-1929-4d05-8c84-40a350c633b5 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:11.146793 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c2706a5-1929-4d05-8c84-40a350c633b5 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:11.147260 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c2706a5-1929-4d05-8c84-40a350c633b5 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:11.148297 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c2706a5-1929-4d05-8c84-40a350c633b5 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:11.148887 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c2706a5-1929-4d05-8c84-40a350c633b5 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:11.260367 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1c99dd41-7d0f-4ef1-9695-736c4b217fc7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:11.261079 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1c99dd41-7d0f-4ef1-9695-736c4b217fc7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:11.269176 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c99dd41-7d0f-4ef1-9695-736c4b217fc7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:11.269774 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c99dd41-7d0f-4ef1-9695-736c4b217fc7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:11.270754 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c99dd41-7d0f-4ef1-9695-736c4b217fc7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:11.271327 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c99dd41-7d0f-4ef1-9695-736c4b217fc7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:11.308215 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1c2706a5-1929-4d05-8c84-40a350c633b5 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:11.316594 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1c2706a5-1929-4d05-8c84-40a350c633b5 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.185395 Dec 15 14:04:11.325839 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 92/177] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:11 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:11.336287 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1c99dd41-7d0f-4ef1-9695-736c4b217fc7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:11.343785 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1c99dd41-7d0f-4ef1-9695-736c4b217fc7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1271 microversion: 2.1 time: 0.087143 Dec 15 14:04:11.344358 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 86/178] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:11 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:11.435170 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e71413f4-b66c-4c50-adc4-9b065622b54f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:11.435660 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e71413f4-b66c-4c50-adc4-9b065622b54f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:11.442675 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e71413f4-b66c-4c50-adc4-9b065622b54f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:11.443113 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e71413f4-b66c-4c50-adc4-9b065622b54f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:11.443888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e71413f4-b66c-4c50-adc4-9b065622b54f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:11.444349 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e71413f4-b66c-4c50-adc4-9b065622b54f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:11.582611 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e71413f4-b66c-4c50-adc4-9b065622b54f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:11.592065 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e71413f4-b66c-4c50-adc4-9b065622b54f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:11.593554 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e71413f4-b66c-4c50-adc4-9b065622b54f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:11.594695 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e71413f4-b66c-4c50-adc4-9b065622b54f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.163563 Dec 15 14:04:11.595225 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 93/179] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:11 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:11.609734 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1d9d414d-0445-4d5b-aa44-9561a4f393fa tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:11.610363 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1d9d414d-0445-4d5b-aa44-9561a4f393fa tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:11.616991 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d9d414d-0445-4d5b-aa44-9561a4f393fa tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:11.617435 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d9d414d-0445-4d5b-aa44-9561a4f393fa tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:11.618249 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d9d414d-0445-4d5b-aa44-9561a4f393fa tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:11.618680 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d9d414d-0445-4d5b-aa44-9561a4f393fa tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:11.739761 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b0269a0c-9ccd-4576-884e-ee862e384c8a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:11.740519 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b0269a0c-9ccd-4576-884e-ee862e384c8a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:11.747082 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0269a0c-9ccd-4576-884e-ee862e384c8a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:11.747603 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0269a0c-9ccd-4576-884e-ee862e384c8a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:11.748398 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0269a0c-9ccd-4576-884e-ee862e384c8a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:11.748830 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0269a0c-9ccd-4576-884e-ee862e384c8a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:11.758397 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1d9d414d-0445-4d5b-aa44-9561a4f393fa tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:11.766133 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1d9d414d-0445-4d5b-aa44-9561a4f393fa tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.160341 Dec 15 14:04:11.767100 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 87/180] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:11 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:11.881603 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b0269a0c-9ccd-4576-884e-ee862e384c8a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:11.889100 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b0269a0c-9ccd-4576-884e-ee862e384c8a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.153128 Dec 15 14:04:11.889694 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 94/181] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:11 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:12.338006 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-851a517c-b338-4d94-b095-1c348ffe64e9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:12.338900 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-851a517c-b338-4d94-b095-1c348ffe64e9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:12.349292 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-851a517c-b338-4d94-b095-1c348ffe64e9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:12.349858 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-851a517c-b338-4d94-b095-1c348ffe64e9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:12.350955 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-851a517c-b338-4d94-b095-1c348ffe64e9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:12.351619 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-851a517c-b338-4d94-b095-1c348ffe64e9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:12.361437 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c41be5eb-ae1a-4f7e-986f-56652c25d4f5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:12.363202 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c41be5eb-ae1a-4f7e-986f-56652c25d4f5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:12.369896 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c41be5eb-ae1a-4f7e-986f-56652c25d4f5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:12.370467 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c41be5eb-ae1a-4f7e-986f-56652c25d4f5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:12.371333 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c41be5eb-ae1a-4f7e-986f-56652c25d4f5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:12.371841 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c41be5eb-ae1a-4f7e-986f-56652c25d4f5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:12.446893 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c41be5eb-ae1a-4f7e-986f-56652c25d4f5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:12.454141 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c41be5eb-ae1a-4f7e-986f-56652c25d4f5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1271 microversion: 2.1 time: 0.097124 Dec 15 14:04:12.454745 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 95/182] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:12 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:12.516409 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-851a517c-b338-4d94-b095-1c348ffe64e9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:12.524171 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-851a517c-b338-4d94-b095-1c348ffe64e9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.192914 Dec 15 14:04:12.524964 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 88/183] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:12 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:12.612817 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4ef7ec53-7ae9-4614-a252-89ac3d337f85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:12.613423 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4ef7ec53-7ae9-4614-a252-89ac3d337f85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:12.619221 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ef7ec53-7ae9-4614-a252-89ac3d337f85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:12.619661 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ef7ec53-7ae9-4614-a252-89ac3d337f85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:12.620675 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ef7ec53-7ae9-4614-a252-89ac3d337f85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:12.621105 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ef7ec53-7ae9-4614-a252-89ac3d337f85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:12.784222 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c6e712bf-2a66-4fdb-bddd-1c4cfa3ee971 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:12.784897 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c6e712bf-2a66-4fdb-bddd-1c4cfa3ee971 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:12.796828 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c6e712bf-2a66-4fdb-bddd-1c4cfa3ee971 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:12.797780 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c6e712bf-2a66-4fdb-bddd-1c4cfa3ee971 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:12.799123 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c6e712bf-2a66-4fdb-bddd-1c4cfa3ee971 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:12.800091 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c6e712bf-2a66-4fdb-bddd-1c4cfa3ee971 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:12.915802 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4ef7ec53-7ae9-4614-a252-89ac3d337f85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:12.923605 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4ef7ec53-7ae9-4614-a252-89ac3d337f85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:12.925114 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4ef7ec53-7ae9-4614-a252-89ac3d337f85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:12.926260 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4ef7ec53-7ae9-4614-a252-89ac3d337f85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.317802 Dec 15 14:04:12.926824 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 96/184] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:12 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:12.931091 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d43bfa58-2add-4a61-b222-e2782f3c198f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:12.931675 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d43bfa58-2add-4a61-b222-e2782f3c198f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:12.940044 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d43bfa58-2add-4a61-b222-e2782f3c198f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:12.940549 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d43bfa58-2add-4a61-b222-e2782f3c198f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:12.941359 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d43bfa58-2add-4a61-b222-e2782f3c198f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:12.941824 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d43bfa58-2add-4a61-b222-e2782f3c198f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:13.093804 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c6e712bf-2a66-4fdb-bddd-1c4cfa3ee971 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:13.102312 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c6e712bf-2a66-4fdb-bddd-1c4cfa3ee971 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.321961 Dec 15 14:04:13.102980 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 89/185] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:12 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:13.201158 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d43bfa58-2add-4a61-b222-e2782f3c198f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:13.209429 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d43bfa58-2add-4a61-b222-e2782f3c198f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.281496 Dec 15 14:04:13.210154 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 97/186] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:12 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:13.472059 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-44c00adc-6db1-49ce-958a-6e81b861b40e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:13.472693 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-44c00adc-6db1-49ce-958a-6e81b861b40e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:13.479433 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44c00adc-6db1-49ce-958a-6e81b861b40e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:13.480095 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44c00adc-6db1-49ce-958a-6e81b861b40e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:13.480928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44c00adc-6db1-49ce-958a-6e81b861b40e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:13.481369 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44c00adc-6db1-49ce-958a-6e81b861b40e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:13.540440 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c52a8e49-4e4b-41e1-90dd-3e7bae9744c1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:13.541034 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c52a8e49-4e4b-41e1-90dd-3e7bae9744c1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:13.547827 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c52a8e49-4e4b-41e1-90dd-3e7bae9744c1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:13.548342 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c52a8e49-4e4b-41e1-90dd-3e7bae9744c1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:13.549184 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c52a8e49-4e4b-41e1-90dd-3e7bae9744c1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:13.549726 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c52a8e49-4e4b-41e1-90dd-3e7bae9744c1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:13.785579 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-44c00adc-6db1-49ce-958a-6e81b861b40e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:13.794568 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-44c00adc-6db1-49ce-958a-6e81b861b40e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1319 microversion: 2.1 time: 0.326773 Dec 15 14:04:13.795249 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 90/187] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:13 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1319 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:13.945083 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-05977923-7cd0-4ab3-a3b5-32232acef671 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:13.945598 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-05977923-7cd0-4ab3-a3b5-32232acef671 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:13.952449 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05977923-7cd0-4ab3-a3b5-32232acef671 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:13.952909 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05977923-7cd0-4ab3-a3b5-32232acef671 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:13.953746 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05977923-7cd0-4ab3-a3b5-32232acef671 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:13.954187 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05977923-7cd0-4ab3-a3b5-32232acef671 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:14.062998 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c52a8e49-4e4b-41e1-90dd-3e7bae9744c1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:14.071340 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c52a8e49-4e4b-41e1-90dd-3e7bae9744c1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.534478 Dec 15 14:04:14.072042 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 98/188] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:13 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:14.120056 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e9ea766e-489e-4c33-a191-31a1c4ebe138 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:14.120789 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e9ea766e-489e-4c33-a191-31a1c4ebe138 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:14.127467 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e9ea766e-489e-4c33-a191-31a1c4ebe138 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:14.128006 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e9ea766e-489e-4c33-a191-31a1c4ebe138 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:14.128772 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e9ea766e-489e-4c33-a191-31a1c4ebe138 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:14.129193 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e9ea766e-489e-4c33-a191-31a1c4ebe138 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:14.294194 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-05977923-7cd0-4ab3-a3b5-32232acef671 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:14.304522 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-05977923-7cd0-4ab3-a3b5-32232acef671 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:14.306050 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-05977923-7cd0-4ab3-a3b5-32232acef671 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:14.307170 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-05977923-7cd0-4ab3-a3b5-32232acef671 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.366206 Dec 15 14:04:14.307731 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 91/189] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:13 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:14.321637 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a6149a86-6c5b-4e66-b496-0e108baaba1e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:14.322246 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a6149a86-6c5b-4e66-b496-0e108baaba1e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:14.328281 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a6149a86-6c5b-4e66-b496-0e108baaba1e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:14.328732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a6149a86-6c5b-4e66-b496-0e108baaba1e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:14.329509 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a6149a86-6c5b-4e66-b496-0e108baaba1e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:14.329984 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a6149a86-6c5b-4e66-b496-0e108baaba1e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:14.421946 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e9ea766e-489e-4c33-a191-31a1c4ebe138 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:14.429474 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e9ea766e-489e-4c33-a191-31a1c4ebe138 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.313112 Dec 15 14:04:14.430276 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 99/190] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:14 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:14.588623 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a6149a86-6c5b-4e66-b496-0e108baaba1e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:14.597191 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a6149a86-6c5b-4e66-b496-0e108baaba1e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.288125 Dec 15 14:04:14.598421 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 92/191] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:14 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:14.787108 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-b0545bad-62de-4dd5-9567-b2a5aff3c2c2 req-eb763140-09cf-4e4d-a095-8aec94040a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55083faf-d97a-45a5-b660-307d716b4b1a", "tag": "4d1a6ff2-6e12-4ab6-b6f0-baa00971cc60"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:14.788970 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:04:14.788970 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:04:14.799439 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-b0545bad-62de-4dd5-9567-b2a5aff3c2c2 req-eb763140-09cf-4e4d-a095-8aec94040a38 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:14.800202 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-b0545bad-62de-4dd5-9567-b2a5aff3c2c2 req-eb763140-09cf-4e4d-a095-8aec94040a38 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:14.812818 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bd455d0c-25c3-4122-86a0-46df4286e94b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:14.814018 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bd455d0c-25c3-4122-86a0-46df4286e94b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:14.821888 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd455d0c-25c3-4122-86a0-46df4286e94b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:14.822903 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd455d0c-25c3-4122-86a0-46df4286e94b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:14.823812 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd455d0c-25c3-4122-86a0-46df4286e94b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:14.824357 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd455d0c-25c3-4122-86a0-46df4286e94b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:14.824894 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-b0545bad-62de-4dd5-9567-b2a5aff3c2c2 req-eb763140-09cf-4e4d-a095-8aec94040a38 service nova] Creating event network-changed:4d1a6ff2-6e12-4ab6-b6f0-baa00971cc60 for instance 55083faf-d97a-45a5-b660-307d716b4b1a on hv-cinder-82182 Dec 15 14:04:14.833347 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-b0545bad-62de-4dd5-9567-b2a5aff3c2c2 req-eb763140-09cf-4e4d-a095-8aec94040a38 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049720 Dec 15 14:04:14.834203 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 100/192] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:04:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:04:15.077699 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bd455d0c-25c3-4122-86a0-46df4286e94b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:15.088492 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bd455d0c-25c3-4122-86a0-46df4286e94b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1319 microversion: 2.1 time: 0.279926 Dec 15 14:04:15.091412 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3e3df27a-3353-438c-ac81-9f63258fd895 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:15.092178 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3e3df27a-3353-438c-ac81-9f63258fd895 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:15.100992 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e3df27a-3353-438c-ac81-9f63258fd895 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:15.102057 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 93/193] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:14 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:15.103222 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e3df27a-3353-438c-ac81-9f63258fd895 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:15.104394 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e3df27a-3353-438c-ac81-9f63258fd895 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:15.106502 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e3df27a-3353-438c-ac81-9f63258fd895 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:15.326903 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c883ab75-5914-43e6-a8ba-8267daa44dd3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:15.327524 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c883ab75-5914-43e6-a8ba-8267daa44dd3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:15.335291 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c883ab75-5914-43e6-a8ba-8267daa44dd3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:15.335416 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c883ab75-5914-43e6-a8ba-8267daa44dd3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:15.336144 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c883ab75-5914-43e6-a8ba-8267daa44dd3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:15.336883 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c883ab75-5914-43e6-a8ba-8267daa44dd3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:15.364355 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3e3df27a-3353-438c-ac81-9f63258fd895 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:15.374829 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3e3df27a-3353-438c-ac81-9f63258fd895 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.287565 Dec 15 14:04:15.375486 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 101/194] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:15 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:15.449048 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-50962514-65d2-4ec3-ad1e-45c06d6903b5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:15.449841 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-50962514-65d2-4ec3-ad1e-45c06d6903b5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:15.456351 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50962514-65d2-4ec3-ad1e-45c06d6903b5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:15.456943 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50962514-65d2-4ec3-ad1e-45c06d6903b5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:15.457694 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50962514-65d2-4ec3-ad1e-45c06d6903b5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:15.458341 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50962514-65d2-4ec3-ad1e-45c06d6903b5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:15.522909 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c883ab75-5914-43e6-a8ba-8267daa44dd3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:15.532821 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c883ab75-5914-43e6-a8ba-8267daa44dd3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:15.534574 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c883ab75-5914-43e6-a8ba-8267daa44dd3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:15.536247 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c883ab75-5914-43e6-a8ba-8267daa44dd3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.214461 Dec 15 14:04:15.536993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 94/195] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:15 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:04:15.615520 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7a5827d6-7696-4066-9b78-7ab2a2585c89 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:15.617052 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7a5827d6-7696-4066-9b78-7ab2a2585c89 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:15.623280 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a5827d6-7696-4066-9b78-7ab2a2585c89 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:15.623732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a5827d6-7696-4066-9b78-7ab2a2585c89 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:15.624519 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a5827d6-7696-4066-9b78-7ab2a2585c89 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:15.624986 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a5827d6-7696-4066-9b78-7ab2a2585c89 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:15.717583 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-50962514-65d2-4ec3-ad1e-45c06d6903b5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:15.725054 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-50962514-65d2-4ec3-ad1e-45c06d6903b5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1315 microversion: 2.1 time: 0.279882 Dec 15 14:04:15.725652 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 102/196] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:15 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:15.870785 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7a5827d6-7696-4066-9b78-7ab2a2585c89 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:15.878488 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7a5827d6-7696-4066-9b78-7ab2a2585c89 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.266933 Dec 15 14:04:15.879055 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 95/197] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:15 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:16.108200 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-66dbc35d-b812-4f95-9b3f-cc991c0ec686 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:16.108816 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-66dbc35d-b812-4f95-9b3f-cc991c0ec686 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:16.115711 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66dbc35d-b812-4f95-9b3f-cc991c0ec686 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:16.116359 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66dbc35d-b812-4f95-9b3f-cc991c0ec686 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:16.117303 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66dbc35d-b812-4f95-9b3f-cc991c0ec686 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:16.117927 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66dbc35d-b812-4f95-9b3f-cc991c0ec686 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:16.267422 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-66dbc35d-b812-4f95-9b3f-cc991c0ec686 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:16.275810 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-66dbc35d-b812-4f95-9b3f-cc991c0ec686 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1319 microversion: 2.1 time: 0.171222 Dec 15 14:04:16.276492 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 103/198] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:16 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:16.393088 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1e14687f-3176-45dd-a605-12a663a7b853 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:16.394270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1e14687f-3176-45dd-a605-12a663a7b853 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:16.400858 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e14687f-3176-45dd-a605-12a663a7b853 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:16.401509 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e14687f-3176-45dd-a605-12a663a7b853 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:16.402617 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e14687f-3176-45dd-a605-12a663a7b853 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:16.402983 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e14687f-3176-45dd-a605-12a663a7b853 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:16.555762 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-db1738d6-7630-4c3b-9947-c200578daf99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:16.557206 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-db1738d6-7630-4c3b-9947-c200578daf99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:16.566882 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db1738d6-7630-4c3b-9947-c200578daf99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:16.568629 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db1738d6-7630-4c3b-9947-c200578daf99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:16.569537 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db1738d6-7630-4c3b-9947-c200578daf99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:16.571638 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db1738d6-7630-4c3b-9947-c200578daf99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:16.580607 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1e14687f-3176-45dd-a605-12a663a7b853 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:16.591816 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1e14687f-3176-45dd-a605-12a663a7b853 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.202839 Dec 15 14:04:16.594317 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 96/199] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:16 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:16.742767 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-534d9cf4-5538-4e5f-8dd6-d0ebe235f02b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:16.743388 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-534d9cf4-5538-4e5f-8dd6-d0ebe235f02b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:16.753756 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-534d9cf4-5538-4e5f-8dd6-d0ebe235f02b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:16.759089 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-534d9cf4-5538-4e5f-8dd6-d0ebe235f02b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:16.761508 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-534d9cf4-5538-4e5f-8dd6-d0ebe235f02b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:16.762575 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-534d9cf4-5538-4e5f-8dd6-d0ebe235f02b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:16.831337 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-db1738d6-7630-4c3b-9947-c200578daf99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:16.840971 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-db1738d6-7630-4c3b-9947-c200578daf99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:16.845968 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-db1738d6-7630-4c3b-9947-c200578daf99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:16.847777 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-db1738d6-7630-4c3b-9947-c200578daf99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.296729 Dec 15 14:04:16.858753 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 104/200] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:16 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:04:16.897040 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-849f419b-f617-4049-8000-59df0c496291 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:16.898576 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-849f419b-f617-4049-8000-59df0c496291 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:16.908728 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-849f419b-f617-4049-8000-59df0c496291 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:16.909771 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-849f419b-f617-4049-8000-59df0c496291 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:16.912127 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-849f419b-f617-4049-8000-59df0c496291 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:16.912759 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-849f419b-f617-4049-8000-59df0c496291 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:16.955734 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-534d9cf4-5538-4e5f-8dd6-d0ebe235f02b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:16.967293 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-534d9cf4-5538-4e5f-8dd6-d0ebe235f02b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1503 microversion: 2.1 time: 0.228204 Dec 15 14:04:16.970404 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 97/201] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:16 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1503 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:17.014936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-374ed874-a6d3-4eba-9d58-380d7edb313b req-8bef240f-b6ff-4943-b336-47cd551010d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfccdaf0-2b79-4ace-a816-8c76eba7f48b", "name": "network-vif-plugged", "status": "completed", "tag": "c6825246-0c77-4125-b93c-02f824de479b"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:17.016874 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:04:17.016874 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:04:17.033950 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-374ed874-a6d3-4eba-9d58-380d7edb313b req-8bef240f-b6ff-4943-b336-47cd551010d7 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:17.034749 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-374ed874-a6d3-4eba-9d58-380d7edb313b req-8bef240f-b6ff-4943-b336-47cd551010d7 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:17.062638 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-374ed874-a6d3-4eba-9d58-380d7edb313b req-8bef240f-b6ff-4943-b336-47cd551010d7 service nova] Creating event network-vif-plugged:c6825246-0c77-4125-b93c-02f824de479b for instance bfccdaf0-2b79-4ace-a816-8c76eba7f48b on hv-cinder-82182 Dec 15 14:04:17.074576 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-374ed874-a6d3-4eba-9d58-380d7edb313b req-8bef240f-b6ff-4943-b336-47cd551010d7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064830 Dec 15 14:04:17.078028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 98/202] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:04:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:04:17.140952 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-849f419b-f617-4049-8000-59df0c496291 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:17.153967 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-849f419b-f617-4049-8000-59df0c496291 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.260566 Dec 15 14:04:17.156206 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 105/203] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:16 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:17.300015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-22c93dfb-1f94-47a4-935e-84c678fc6416 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:17.301406 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-22c93dfb-1f94-47a4-935e-84c678fc6416 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:17.309230 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-22c93dfb-1f94-47a4-935e-84c678fc6416 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:17.309951 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-22c93dfb-1f94-47a4-935e-84c678fc6416 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:17.311968 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-22c93dfb-1f94-47a4-935e-84c678fc6416 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:17.312587 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-22c93dfb-1f94-47a4-935e-84c678fc6416 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:17.596992 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-22c93dfb-1f94-47a4-935e-84c678fc6416 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:17.613190 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b2403635-c646-46e8-a63d-82aede5681cf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:17.613822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b2403635-c646-46e8-a63d-82aede5681cf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:17.618965 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-22c93dfb-1f94-47a4-935e-84c678fc6416 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1319 microversion: 2.1 time: 0.326445 Dec 15 14:04:17.619555 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 99/204] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:17 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:17.631452 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b2403635-c646-46e8-a63d-82aede5681cf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:17.631908 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b2403635-c646-46e8-a63d-82aede5681cf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:17.632713 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b2403635-c646-46e8-a63d-82aede5681cf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:17.633145 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b2403635-c646-46e8-a63d-82aede5681cf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:17.830410 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b2403635-c646-46e8-a63d-82aede5681cf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:17.838877 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b2403635-c646-46e8-a63d-82aede5681cf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.231656 Dec 15 14:04:17.839473 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 106/205] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:17 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:17.869168 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-67a53e6a-cb8b-4cef-9a15-f9425d9c3757 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:17.870596 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-67a53e6a-cb8b-4cef-9a15-f9425d9c3757 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:17.879675 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67a53e6a-cb8b-4cef-9a15-f9425d9c3757 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:17.880261 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67a53e6a-cb8b-4cef-9a15-f9425d9c3757 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:17.881286 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67a53e6a-cb8b-4cef-9a15-f9425d9c3757 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:17.881893 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67a53e6a-cb8b-4cef-9a15-f9425d9c3757 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:18.038102 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-67a53e6a-cb8b-4cef-9a15-f9425d9c3757 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:18.046829 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-67a53e6a-cb8b-4cef-9a15-f9425d9c3757 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:18.048482 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-67a53e6a-cb8b-4cef-9a15-f9425d9c3757 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:18.049775 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-67a53e6a-cb8b-4cef-9a15-f9425d9c3757 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.186573 Dec 15 14:04:18.050613 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 100/206] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:17 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:18.172228 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d0a6d175-9be2-4a3c-bf98-fbf4f714a8bf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:18.172880 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d0a6d175-9be2-4a3c-bf98-fbf4f714a8bf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:18.179324 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0a6d175-9be2-4a3c-bf98-fbf4f714a8bf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:18.179770 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0a6d175-9be2-4a3c-bf98-fbf4f714a8bf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:18.180786 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0a6d175-9be2-4a3c-bf98-fbf4f714a8bf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:18.181218 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0a6d175-9be2-4a3c-bf98-fbf4f714a8bf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:18.348220 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d0a6d175-9be2-4a3c-bf98-fbf4f714a8bf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:18.356168 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d0a6d175-9be2-4a3c-bf98-fbf4f714a8bf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.187793 Dec 15 14:04:18.357642 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 107/207] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:18 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:18.533564 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7d8f36dc-5db5-4402-99a4-19e708f98b8d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7fb01d2-5089-4afe-8250-32fe9e92e144"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:18.534737 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7d8f36dc-5db5-4402-99a4-19e708f98b8d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:18.540922 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7d8f36dc-5db5-4402-99a4-19e708f98b8d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:18.541407 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7d8f36dc-5db5-4402-99a4-19e708f98b8d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:18.542352 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7d8f36dc-5db5-4402-99a4-19e708f98b8d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:18.542822 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7d8f36dc-5db5-4402-99a4-19e708f98b8d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:18.638412 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c5dcf975-7726-48f9-beee-356201e69fce tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:18.639018 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c5dcf975-7726-48f9-beee-356201e69fce tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:18.648034 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c5dcf975-7726-48f9-beee-356201e69fce tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:18.648701 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c5dcf975-7726-48f9-beee-356201e69fce tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:18.649696 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c5dcf975-7726-48f9-beee-356201e69fce tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:18.650472 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c5dcf975-7726-48f9-beee-356201e69fce tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:18.835252 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c5dcf975-7726-48f9-beee-356201e69fce tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:18.846733 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c5dcf975-7726-48f9-beee-356201e69fce tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1319 microversion: 2.1 time: 0.213402 Dec 15 14:04:18.847687 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 108/208] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:18 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:18.863488 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c495fe5f-7453-4e1b-9e47-37afb0e8924e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:18.864402 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c495fe5f-7453-4e1b-9e47-37afb0e8924e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:18.872622 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c495fe5f-7453-4e1b-9e47-37afb0e8924e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:18.873484 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c495fe5f-7453-4e1b-9e47-37afb0e8924e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:18.874536 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c495fe5f-7453-4e1b-9e47-37afb0e8924e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:18.875785 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c495fe5f-7453-4e1b-9e47-37afb0e8924e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:19.000619 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7d8f36dc-5db5-4402-99a4-19e708f98b8d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "POST /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.471160 Dec 15 14:04:19.006675 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 101/209] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Dec 15 14:04:18 2021] POST /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc/os-volume_attachments => generated 194 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:04:19.049119 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c495fe5f-7453-4e1b-9e47-37afb0e8924e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:19.060297 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c495fe5f-7453-4e1b-9e47-37afb0e8924e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.205349 Dec 15 14:04:19.061567 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 109/210] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:18 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:19.081113 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ef466983-3f52-4e73-8c92-e9c549102eae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:19.081888 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ef466983-3f52-4e73-8c92-e9c549102eae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:19.097092 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef466983-3f52-4e73-8c92-e9c549102eae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:19.097628 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef466983-3f52-4e73-8c92-e9c549102eae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:19.098561 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef466983-3f52-4e73-8c92-e9c549102eae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:19.099004 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef466983-3f52-4e73-8c92-e9c549102eae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:19.101190 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-a2431cb1-3b04-42b7-8acd-a67e09854baa req-3d05cff8-f49d-4294-a356-87dfba69324b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08832229-b545-4a06-a332-54ab9a72bacd", "name": "network-vif-plugged", "status": "completed", "tag": "96478e00-8427-434c-8484-2d9c25c7698e"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:19.103093 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:04:19.103093 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:04:19.111247 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-a2431cb1-3b04-42b7-8acd-a67e09854baa req-3d05cff8-f49d-4294-a356-87dfba69324b service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:19.111785 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-a2431cb1-3b04-42b7-8acd-a67e09854baa req-3d05cff8-f49d-4294-a356-87dfba69324b service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:19.123527 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-a2431cb1-3b04-42b7-8acd-a67e09854baa req-3d05cff8-f49d-4294-a356-87dfba69324b service nova] Creating event network-vif-plugged:96478e00-8427-434c-8484-2d9c25c7698e for instance 08832229-b545-4a06-a332-54ab9a72bacd on hv-cinder-82182 Dec 15 14:04:19.129103 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-a2431cb1-3b04-42b7-8acd-a67e09854baa req-3d05cff8-f49d-4294-a356-87dfba69324b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032599 Dec 15 14:04:19.130043 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 110/211] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:04:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:04:19.279196 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ef466983-3f52-4e73-8c92-e9c549102eae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:19.288341 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ef466983-3f52-4e73-8c92-e9c549102eae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:19.289939 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ef466983-3f52-4e73-8c92-e9c549102eae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:19.293946 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ef466983-3f52-4e73-8c92-e9c549102eae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.221589 Dec 15 14:04:19.305937 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 102/212] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:19 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:19.375848 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-21653fde-2347-41f2-a0f4-5c2fe4a99744 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:19.377953 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-21653fde-2347-41f2-a0f4-5c2fe4a99744 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:19.393682 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21653fde-2347-41f2-a0f4-5c2fe4a99744 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:19.395040 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21653fde-2347-41f2-a0f4-5c2fe4a99744 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:19.397335 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21653fde-2347-41f2-a0f4-5c2fe4a99744 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:19.398220 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21653fde-2347-41f2-a0f4-5c2fe4a99744 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:19.639218 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-21653fde-2347-41f2-a0f4-5c2fe4a99744 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:19.646749 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-21653fde-2347-41f2-a0f4-5c2fe4a99744 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.276188 Dec 15 14:04:19.647324 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 111/213] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:19 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:19.867848 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-37bc9830-c993-4108-bb3c-997f4d75a00e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:19.868452 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-37bc9830-c993-4108-bb3c-997f4d75a00e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:19.875872 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-37bc9830-c993-4108-bb3c-997f4d75a00e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:19.876328 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-37bc9830-c993-4108-bb3c-997f4d75a00e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:19.877208 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-37bc9830-c993-4108-bb3c-997f4d75a00e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:19.877802 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-37bc9830-c993-4108-bb3c-997f4d75a00e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:20.026039 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-37bc9830-c993-4108-bb3c-997f4d75a00e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:20.034734 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-37bc9830-c993-4108-bb3c-997f4d75a00e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1319 microversion: 2.1 time: 0.170452 Dec 15 14:04:20.035642 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 103/214] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:19 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:20.085975 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f70208aa-f178-44c9-9f6f-402d6c5a1980 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:20.086532 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f70208aa-f178-44c9-9f6f-402d6c5a1980 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:20.092634 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f70208aa-f178-44c9-9f6f-402d6c5a1980 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:20.093069 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f70208aa-f178-44c9-9f6f-402d6c5a1980 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:20.094132 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f70208aa-f178-44c9-9f6f-402d6c5a1980 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:20.094393 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f70208aa-f178-44c9-9f6f-402d6c5a1980 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:20.247550 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f70208aa-f178-44c9-9f6f-402d6c5a1980 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:20.255855 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f70208aa-f178-44c9-9f6f-402d6c5a1980 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.173992 Dec 15 14:04:20.256578 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 112/215] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:20 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:20.313274 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-369afd5f-fff1-4220-81cb-285bed01ceda tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:20.313999 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-369afd5f-fff1-4220-81cb-285bed01ceda tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:20.320408 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-369afd5f-fff1-4220-81cb-285bed01ceda tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:20.320844 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-369afd5f-fff1-4220-81cb-285bed01ceda tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:20.321654 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-369afd5f-fff1-4220-81cb-285bed01ceda tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:20.322093 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-369afd5f-fff1-4220-81cb-285bed01ceda tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:20.461288 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-369afd5f-fff1-4220-81cb-285bed01ceda tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:20.469337 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-369afd5f-fff1-4220-81cb-285bed01ceda tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:20.470837 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-369afd5f-fff1-4220-81cb-285bed01ceda tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:20.472115 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-369afd5f-fff1-4220-81cb-285bed01ceda tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.163368 Dec 15 14:04:20.472699 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 104/216] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:20 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:04:20.663345 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3e0cae18-464d-48f9-8e99-2dc0f76fa23b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:20.664050 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3e0cae18-464d-48f9-8e99-2dc0f76fa23b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:20.669995 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e0cae18-464d-48f9-8e99-2dc0f76fa23b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:20.670468 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e0cae18-464d-48f9-8e99-2dc0f76fa23b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:20.671266 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e0cae18-464d-48f9-8e99-2dc0f76fa23b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:20.671700 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e0cae18-464d-48f9-8e99-2dc0f76fa23b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:20.816289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3e0cae18-464d-48f9-8e99-2dc0f76fa23b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:20.825103 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3e0cae18-464d-48f9-8e99-2dc0f76fa23b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.165574 Dec 15 14:04:20.825602 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 113/217] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:20 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:21.052176 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-070c1b86-7572-4657-8bde-8ea851e88d71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:21.052783 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-070c1b86-7572-4657-8bde-8ea851e88d71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:21.058986 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-070c1b86-7572-4657-8bde-8ea851e88d71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:21.059427 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-070c1b86-7572-4657-8bde-8ea851e88d71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:21.060191 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-070c1b86-7572-4657-8bde-8ea851e88d71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:21.060616 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-070c1b86-7572-4657-8bde-8ea851e88d71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:21.148352 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-48c41faf-3b6e-43a5-bb4a-0fed32dad201 req-11340ca3-bfa1-4bdd-9a1d-2d906db986ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbed1ca6-db9b-4346-9edd-5047a3e302e7", "name": "network-vif-plugged", "status": "completed", "tag": "0ac2210e-a283-4a63-80c5-bed03c1478de"}, {"server_uuid": "fcc65306-f419-4eac-97a2-407c5d6744da", "name": "network-vif-plugged", "status": "completed", "tag": "7989001b-405b-4c40-b4ff-1aeb457e4e50"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:21.152053 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:04:21.152053 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:04:21.161058 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-48c41faf-3b6e-43a5-bb4a-0fed32dad201 req-11340ca3-bfa1-4bdd-9a1d-2d906db986ec service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:21.161550 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-48c41faf-3b6e-43a5-bb4a-0fed32dad201 req-11340ca3-bfa1-4bdd-9a1d-2d906db986ec service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:21.175415 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-48c41faf-3b6e-43a5-bb4a-0fed32dad201 req-11340ca3-bfa1-4bdd-9a1d-2d906db986ec service nova] Creating event network-vif-plugged:0ac2210e-a283-4a63-80c5-bed03c1478de for instance cbed1ca6-db9b-4346-9edd-5047a3e302e7 on hv-cinder-82182 Dec 15 14:04:21.175915 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-48c41faf-3b6e-43a5-bb4a-0fed32dad201 req-11340ca3-bfa1-4bdd-9a1d-2d906db986ec service nova] Creating event network-vif-plugged:7989001b-405b-4c40-b4ff-1aeb457e4e50 for instance fcc65306-f419-4eac-97a2-407c5d6744da on hv-cinder-82182 Dec 15 14:04:21.183003 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-48c41faf-3b6e-43a5-bb4a-0fed32dad201 req-11340ca3-bfa1-4bdd-9a1d-2d906db986ec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038232 Dec 15 14:04:21.183616 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 114/218] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:04:21 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:04:21.274010 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-47d7b61b-0976-4edf-a2a8-01247a4d5f4c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:21.274843 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-47d7b61b-0976-4edf-a2a8-01247a4d5f4c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:21.282219 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47d7b61b-0976-4edf-a2a8-01247a4d5f4c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:21.283225 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47d7b61b-0976-4edf-a2a8-01247a4d5f4c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:21.284447 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47d7b61b-0976-4edf-a2a8-01247a4d5f4c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:21.284895 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47d7b61b-0976-4edf-a2a8-01247a4d5f4c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:21.427152 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-070c1b86-7572-4657-8bde-8ea851e88d71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:21.435234 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-070c1b86-7572-4657-8bde-8ea851e88d71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1319 microversion: 2.1 time: 0.386683 Dec 15 14:04:21.436126 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 105/219] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:21 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1319 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:21.468881 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-47d7b61b-0976-4edf-a2a8-01247a4d5f4c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:21.477781 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-47d7b61b-0976-4edf-a2a8-01247a4d5f4c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.207973 Dec 15 14:04:21.478347 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 115/220] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:21 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:21.490542 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-95a7f618-8579-4d2f-b0d4-a88d44667897 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:21.491148 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-95a7f618-8579-4d2f-b0d4-a88d44667897 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:21.497494 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-95a7f618-8579-4d2f-b0d4-a88d44667897 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:21.497978 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-95a7f618-8579-4d2f-b0d4-a88d44667897 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:21.498754 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-95a7f618-8579-4d2f-b0d4-a88d44667897 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:21.499181 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-95a7f618-8579-4d2f-b0d4-a88d44667897 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:21.643133 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-95a7f618-8579-4d2f-b0d4-a88d44667897 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:21.651931 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-95a7f618-8579-4d2f-b0d4-a88d44667897 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:21.653390 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-95a7f618-8579-4d2f-b0d4-a88d44667897 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:21.654517 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-95a7f618-8579-4d2f-b0d4-a88d44667897 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.167780 Dec 15 14:04:21.655171 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 106/221] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:21 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:21.844663 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-30fd5fab-1154-44fd-a97c-52752a84ddc4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:21.845513 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-30fd5fab-1154-44fd-a97c-52752a84ddc4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:21.854115 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30fd5fab-1154-44fd-a97c-52752a84ddc4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:21.854713 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30fd5fab-1154-44fd-a97c-52752a84ddc4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:21.855749 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30fd5fab-1154-44fd-a97c-52752a84ddc4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:21.856325 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30fd5fab-1154-44fd-a97c-52752a84ddc4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:22.000668 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-30fd5fab-1154-44fd-a97c-52752a84ddc4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:22.009652 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-30fd5fab-1154-44fd-a97c-52752a84ddc4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.169917 Dec 15 14:04:22.010264 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 116/222] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:21 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:22.457518 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ce541eab-6119-4567-9245-38fd05de49a8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:22.458143 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ce541eab-6119-4567-9245-38fd05de49a8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:22.464838 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce541eab-6119-4567-9245-38fd05de49a8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:22.465285 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce541eab-6119-4567-9245-38fd05de49a8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:22.466197 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce541eab-6119-4567-9245-38fd05de49a8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:22.466623 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce541eab-6119-4567-9245-38fd05de49a8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:22.495188 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7fb713c1-a687-4102-9ee6-a96b04235466 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:22.495797 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7fb713c1-a687-4102-9ee6-a96b04235466 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:22.502112 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fb713c1-a687-4102-9ee6-a96b04235466 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:22.502566 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fb713c1-a687-4102-9ee6-a96b04235466 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:22.503424 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fb713c1-a687-4102-9ee6-a96b04235466 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:22.504007 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fb713c1-a687-4102-9ee6-a96b04235466 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:22.657328 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ce541eab-6119-4567-9245-38fd05de49a8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:22.665237 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ce541eab-6119-4567-9245-38fd05de49a8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1319 microversion: 2.1 time: 0.211529 Dec 15 14:04:22.674804 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 107/223] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:22 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:22.674804 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5e789491-1f87-4b7b-b49b-9bea6271a3c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:22.675647 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5e789491-1f87-4b7b-b49b-9bea6271a3c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:22.681878 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e789491-1f87-4b7b-b49b-9bea6271a3c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:22.682333 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e789491-1f87-4b7b-b49b-9bea6271a3c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:22.683118 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e789491-1f87-4b7b-b49b-9bea6271a3c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:22.683553 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e789491-1f87-4b7b-b49b-9bea6271a3c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:22.685254 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7fb713c1-a687-4102-9ee6-a96b04235466 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:22.693082 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7fb713c1-a687-4102-9ee6-a96b04235466 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.201693 Dec 15 14:04:22.693642 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 117/224] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:22 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:22.830817 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5e789491-1f87-4b7b-b49b-9bea6271a3c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:22.839518 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5e789491-1f87-4b7b-b49b-9bea6271a3c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:22.841042 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5e789491-1f87-4b7b-b49b-9bea6271a3c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:22.842178 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5e789491-1f87-4b7b-b49b-9bea6271a3c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.171148 Dec 15 14:04:22.842756 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 108/225] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:22 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:23.037151 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-794e7348-f901-4550-a5ef-cff78e432ec0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:23.038216 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-794e7348-f901-4550-a5ef-cff78e432ec0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:23.048647 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-794e7348-f901-4550-a5ef-cff78e432ec0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:23.049387 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-794e7348-f901-4550-a5ef-cff78e432ec0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:23.050769 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-794e7348-f901-4550-a5ef-cff78e432ec0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:23.051195 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-794e7348-f901-4550-a5ef-cff78e432ec0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:23.206825 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-794e7348-f901-4550-a5ef-cff78e432ec0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:23.221112 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-794e7348-f901-4550-a5ef-cff78e432ec0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.190024 Dec 15 14:04:23.222028 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 118/226] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:23 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:23.683614 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6f681111-d060-40cb-a94a-b87976b08dcd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:23.684395 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6f681111-d060-40cb-a94a-b87976b08dcd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:23.692269 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f681111-d060-40cb-a94a-b87976b08dcd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:23.692803 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f681111-d060-40cb-a94a-b87976b08dcd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:23.693715 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f681111-d060-40cb-a94a-b87976b08dcd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:23.694153 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f681111-d060-40cb-a94a-b87976b08dcd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:23.709836 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2b0ffc17-816b-4fe8-b99e-ed2834a939d7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:23.710515 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2b0ffc17-816b-4fe8-b99e-ed2834a939d7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:23.716807 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2b0ffc17-816b-4fe8-b99e-ed2834a939d7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:23.717255 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2b0ffc17-816b-4fe8-b99e-ed2834a939d7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:23.718050 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2b0ffc17-816b-4fe8-b99e-ed2834a939d7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:23.718469 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2b0ffc17-816b-4fe8-b99e-ed2834a939d7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:23.896517 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6f681111-d060-40cb-a94a-b87976b08dcd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:23.901171 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2b0ffc17-816b-4fe8-b99e-ed2834a939d7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:23.904798 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6f681111-d060-40cb-a94a-b87976b08dcd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1319 microversion: 2.1 time: 0.225407 Dec 15 14:04:23.905373 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 109/227] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:23 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:23.908787 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2b0ffc17-816b-4fe8-b99e-ed2834a939d7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.202603 Dec 15 14:04:23.909502 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 119/228] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:23 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:23.910943 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ee6f06db-5968-4c8c-b0c2-8c4631230a1b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:23.911571 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ee6f06db-5968-4c8c-b0c2-8c4631230a1b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:23.917711 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ee6f06db-5968-4c8c-b0c2-8c4631230a1b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:23.918154 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ee6f06db-5968-4c8c-b0c2-8c4631230a1b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:23.918920 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ee6f06db-5968-4c8c-b0c2-8c4631230a1b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:23.919347 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ee6f06db-5968-4c8c-b0c2-8c4631230a1b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:24.056989 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ee6f06db-5968-4c8c-b0c2-8c4631230a1b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:24.065483 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ee6f06db-5968-4c8c-b0c2-8c4631230a1b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:24.067066 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ee6f06db-5968-4c8c-b0c2-8c4631230a1b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:24.068186 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ee6f06db-5968-4c8c-b0c2-8c4631230a1b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.161831 Dec 15 14:04:24.068751 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 110/229] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:23 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:24.244026 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-41faa649-920a-42cd-9165-62aa358e7a88 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:24.244651 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-41faa649-920a-42cd-9165-62aa358e7a88 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:24.251285 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-41faa649-920a-42cd-9165-62aa358e7a88 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:24.251711 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-41faa649-920a-42cd-9165-62aa358e7a88 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:24.252526 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-41faa649-920a-42cd-9165-62aa358e7a88 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:24.253015 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-41faa649-920a-42cd-9165-62aa358e7a88 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:24.402423 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-41faa649-920a-42cd-9165-62aa358e7a88 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:24.411227 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-41faa649-920a-42cd-9165-62aa358e7a88 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.170904 Dec 15 14:04:24.411773 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 120/230] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:24 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:24.922747 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b4d8a84b-2a95-4e86-a8b7-775914b8c23d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:24.923453 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b4d8a84b-2a95-4e86-a8b7-775914b8c23d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:24.927106 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3f4e5e74-8f80-4cce-b2c9-8fd2e94c7c3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:24.927903 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3f4e5e74-8f80-4cce-b2c9-8fd2e94c7c3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:24.931928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4d8a84b-2a95-4e86-a8b7-775914b8c23d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:24.932477 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4d8a84b-2a95-4e86-a8b7-775914b8c23d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:24.933449 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4d8a84b-2a95-4e86-a8b7-775914b8c23d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:24.934030 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4d8a84b-2a95-4e86-a8b7-775914b8c23d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:24.935563 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f4e5e74-8f80-4cce-b2c9-8fd2e94c7c3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:24.936118 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f4e5e74-8f80-4cce-b2c9-8fd2e94c7c3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:24.937126 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f4e5e74-8f80-4cce-b2c9-8fd2e94c7c3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:24.937667 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f4e5e74-8f80-4cce-b2c9-8fd2e94c7c3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:25.214433 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b4d8a84b-2a95-4e86-a8b7-775914b8c23d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:25.222100 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b4d8a84b-2a95-4e86-a8b7-775914b8c23d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1319 microversion: 2.1 time: 0.304066 Dec 15 14:04:25.222675 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 111/231] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:24 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:25.227852 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ef99b3be-053c-41f4-97eb-fcaeeebd77ad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:25.228458 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ef99b3be-053c-41f4-97eb-fcaeeebd77ad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:25.235149 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef99b3be-053c-41f4-97eb-fcaeeebd77ad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:25.235749 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef99b3be-053c-41f4-97eb-fcaeeebd77ad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:25.236552 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef99b3be-053c-41f4-97eb-fcaeeebd77ad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:25.237201 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef99b3be-053c-41f4-97eb-fcaeeebd77ad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:25.240018 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3f4e5e74-8f80-4cce-b2c9-8fd2e94c7c3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:25.247648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3f4e5e74-8f80-4cce-b2c9-8fd2e94c7c3b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.325266 Dec 15 14:04:25.249784 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 121/232] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:24 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:25.375948 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ef99b3be-053c-41f4-97eb-fcaeeebd77ad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:25.384022 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ef99b3be-053c-41f4-97eb-fcaeeebd77ad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:25.385496 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ef99b3be-053c-41f4-97eb-fcaeeebd77ad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:25.386663 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ef99b3be-053c-41f4-97eb-fcaeeebd77ad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.162607 Dec 15 14:04:25.387210 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 112/233] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:25 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:25.428323 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ef15daf1-d32b-470e-bdb4-92388cdd5885 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:25.428918 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ef15daf1-d32b-470e-bdb4-92388cdd5885 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:25.435656 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ef15daf1-d32b-470e-bdb4-92388cdd5885 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:25.435977 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ef15daf1-d32b-470e-bdb4-92388cdd5885 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:25.436845 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ef15daf1-d32b-470e-bdb4-92388cdd5885 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:25.437269 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ef15daf1-d32b-470e-bdb4-92388cdd5885 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:25.585667 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ef15daf1-d32b-470e-bdb4-92388cdd5885 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:25.593248 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ef15daf1-d32b-470e-bdb4-92388cdd5885 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.168637 Dec 15 14:04:25.593837 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 122/234] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:25 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:26.239774 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d1cf31c3-efc1-43a2-9908-f5a2ca742e97 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:26.240408 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d1cf31c3-efc1-43a2-9908-f5a2ca742e97 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:26.247552 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1cf31c3-efc1-43a2-9908-f5a2ca742e97 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:26.248003 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1cf31c3-efc1-43a2-9908-f5a2ca742e97 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:26.248811 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1cf31c3-efc1-43a2-9908-f5a2ca742e97 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:26.249247 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1cf31c3-efc1-43a2-9908-f5a2ca742e97 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:26.266212 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a9873d4e-9c6b-4b51-9f13-f2435d8553b8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:26.266901 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a9873d4e-9c6b-4b51-9f13-f2435d8553b8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:26.273066 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a9873d4e-9c6b-4b51-9f13-f2435d8553b8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:26.273566 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a9873d4e-9c6b-4b51-9f13-f2435d8553b8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:26.274564 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a9873d4e-9c6b-4b51-9f13-f2435d8553b8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:26.274993 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a9873d4e-9c6b-4b51-9f13-f2435d8553b8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:26.584988 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d1cf31c3-efc1-43a2-9908-f5a2ca742e97 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:26.593132 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a9873d4e-9c6b-4b51-9f13-f2435d8553b8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:26.597812 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d1cf31c3-efc1-43a2-9908-f5a2ca742e97 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1319 microversion: 2.1 time: 0.361854 Dec 15 14:04:26.602438 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a9873d4e-9c6b-4b51-9f13-f2435d8553b8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.340082 Dec 15 14:04:26.613945 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 113/235] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:26 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:26.614136 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 123/236] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:26 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:26.619978 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cfc209d7-0d45-4b2b-8661-b6c7e2a499c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:26.620168 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fa4b726c-83d9-4229-8382-4365ec443051 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:26.620620 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fa4b726c-83d9-4229-8382-4365ec443051 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:26.620750 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cfc209d7-0d45-4b2b-8661-b6c7e2a499c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:26.629441 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cfc209d7-0d45-4b2b-8661-b6c7e2a499c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:26.630076 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cfc209d7-0d45-4b2b-8661-b6c7e2a499c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:26.631118 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cfc209d7-0d45-4b2b-8661-b6c7e2a499c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:26.631727 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cfc209d7-0d45-4b2b-8661-b6c7e2a499c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:26.634854 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa4b726c-83d9-4229-8382-4365ec443051 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:26.634854 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa4b726c-83d9-4229-8382-4365ec443051 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:26.635532 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa4b726c-83d9-4229-8382-4365ec443051 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:26.635966 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa4b726c-83d9-4229-8382-4365ec443051 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:26.946769 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fa4b726c-83d9-4229-8382-4365ec443051 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:26.957626 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cfc209d7-0d45-4b2b-8661-b6c7e2a499c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:26.963938 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fa4b726c-83d9-4229-8382-4365ec443051 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:26.965703 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fa4b726c-83d9-4229-8382-4365ec443051 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:26.966739 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fa4b726c-83d9-4229-8382-4365ec443051 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.352441 Dec 15 14:04:26.967328 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 114/237] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:26 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:26.968675 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cfc209d7-0d45-4b2b-8661-b6c7e2a499c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.353349 Dec 15 14:04:26.969368 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 124/238] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:26 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:26.972044 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-c0fc729a-9da0-48da-b3fe-d15fc2297064 req-2aee1bcd-a365-4959-8ca7-28205ac98b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55083faf-d97a-45a5-b660-307d716b4b1a", "name": "network-vif-plugged", "status": "completed", "tag": "4d1a6ff2-6e12-4ab6-b6f0-baa00971cc60"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:26.973594 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:04:26.973594 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:04:26.981010 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-c0fc729a-9da0-48da-b3fe-d15fc2297064 req-2aee1bcd-a365-4959-8ca7-28205ac98b8e service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:26.981442 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-c0fc729a-9da0-48da-b3fe-d15fc2297064 req-2aee1bcd-a365-4959-8ca7-28205ac98b8e service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:26.994034 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-c0fc729a-9da0-48da-b3fe-d15fc2297064 req-2aee1bcd-a365-4959-8ca7-28205ac98b8e service nova] Creating event network-vif-plugged:4d1a6ff2-6e12-4ab6-b6f0-baa00971cc60 for instance 55083faf-d97a-45a5-b660-307d716b4b1a on hv-cinder-82182 Dec 15 14:04:26.999214 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-c0fc729a-9da0-48da-b3fe-d15fc2297064 req-2aee1bcd-a365-4959-8ca7-28205ac98b8e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030604 Dec 15 14:04:26.999820 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 115/239] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:04:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:04:27.616507 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-17950722-aa21-4e58-9b67-ba1b2127c783 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:27.617222 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-17950722-aa21-4e58-9b67-ba1b2127c783 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:27.621163 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b2e257d8-b04c-4052-aaa1-6b459afbf10d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:27.621985 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b2e257d8-b04c-4052-aaa1-6b459afbf10d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:27.624071 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17950722-aa21-4e58-9b67-ba1b2127c783 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:27.625124 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17950722-aa21-4e58-9b67-ba1b2127c783 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:27.626008 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17950722-aa21-4e58-9b67-ba1b2127c783 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:27.626453 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17950722-aa21-4e58-9b67-ba1b2127c783 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:27.629029 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b2e257d8-b04c-4052-aaa1-6b459afbf10d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:27.629769 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b2e257d8-b04c-4052-aaa1-6b459afbf10d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:27.632360 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b2e257d8-b04c-4052-aaa1-6b459afbf10d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:27.632918 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b2e257d8-b04c-4052-aaa1-6b459afbf10d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:27.839491 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-17950722-aa21-4e58-9b67-ba1b2127c783 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:27.846894 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-17950722-aa21-4e58-9b67-ba1b2127c783 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1319 microversion: 2.1 time: 0.234125 Dec 15 14:04:27.847388 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 125/240] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:27 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:27.856657 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b2e257d8-b04c-4052-aaa1-6b459afbf10d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:27.864445 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b2e257d8-b04c-4052-aaa1-6b459afbf10d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1321 microversion: 2.1 time: 0.248295 Dec 15 14:04:27.865015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 116/241] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:27 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:27.987574 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3b7a0c65-d54e-4184-8155-eb6105b0bb4e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:27.988183 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3b7a0c65-d54e-4184-8155-eb6105b0bb4e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:27.989434 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2616dcd2-0d1e-4c09-a04b-e53823ef1229 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:27.997590 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b7a0c65-d54e-4184-8155-eb6105b0bb4e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:27.998083 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b7a0c65-d54e-4184-8155-eb6105b0bb4e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:27.998548 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2616dcd2-0d1e-4c09-a04b-e53823ef1229 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:27.998882 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b7a0c65-d54e-4184-8155-eb6105b0bb4e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:28.005183 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b7a0c65-d54e-4184-8155-eb6105b0bb4e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:28.010015 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2616dcd2-0d1e-4c09-a04b-e53823ef1229 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:28.011124 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2616dcd2-0d1e-4c09-a04b-e53823ef1229 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:28.012714 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2616dcd2-0d1e-4c09-a04b-e53823ef1229 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:28.013762 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2616dcd2-0d1e-4c09-a04b-e53823ef1229 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:28.303233 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3b7a0c65-d54e-4184-8155-eb6105b0bb4e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:28.311459 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3b7a0c65-d54e-4184-8155-eb6105b0bb4e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:28.314263 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3b7a0c65-d54e-4184-8155-eb6105b0bb4e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:28.315982 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3b7a0c65-d54e-4184-8155-eb6105b0bb4e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1405 microversion: 2.20 time: 0.333541 Dec 15 14:04:28.327154 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 117/242] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:27 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1405 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:28.327480 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2616dcd2-0d1e-4c09-a04b-e53823ef1229 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:28.332412 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2616dcd2-0d1e-4c09-a04b-e53823ef1229 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1362 microversion: 2.1 time: 0.349904 Dec 15 14:04:28.333137 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 126/243] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:27 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:28.864438 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ce5dad31-aa27-4fc2-9856-79072b2aa0dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:28.865183 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ce5dad31-aa27-4fc2-9856-79072b2aa0dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:28.871898 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce5dad31-aa27-4fc2-9856-79072b2aa0dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:28.872316 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce5dad31-aa27-4fc2-9856-79072b2aa0dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:28.873133 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce5dad31-aa27-4fc2-9856-79072b2aa0dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:28.873572 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce5dad31-aa27-4fc2-9856-79072b2aa0dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:28.881813 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-aa1d82c4-2e21-492d-b89b-ca067e1cf0c1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:28.882445 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-aa1d82c4-2e21-492d-b89b-ca067e1cf0c1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:28.888515 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa1d82c4-2e21-492d-b89b-ca067e1cf0c1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:28.888963 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa1d82c4-2e21-492d-b89b-ca067e1cf0c1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:28.889800 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa1d82c4-2e21-492d-b89b-ca067e1cf0c1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:28.890237 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa1d82c4-2e21-492d-b89b-ca067e1cf0c1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:29.090831 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ce5dad31-aa27-4fc2-9856-79072b2aa0dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:29.094606 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-aa1d82c4-2e21-492d-b89b-ca067e1cf0c1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:29.098470 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ce5dad31-aa27-4fc2-9856-79072b2aa0dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1319 microversion: 2.1 time: 0.237691 Dec 15 14:04:29.099043 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 118/244] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:28 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:29.103295 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-aa1d82c4-2e21-492d-b89b-ca067e1cf0c1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1514 microversion: 2.1 time: 0.225224 Dec 15 14:04:29.103988 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 127/245] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:28 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1514 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:29.120975 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-60d27c85-b44f-4cc1-9a28-ff88a1d7ec72 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:29.122010 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-60d27c85-b44f-4cc1-9a28-ff88a1d7ec72 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:29.127808 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60d27c85-b44f-4cc1-9a28-ff88a1d7ec72 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:29.128270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60d27c85-b44f-4cc1-9a28-ff88a1d7ec72 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:29.129050 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60d27c85-b44f-4cc1-9a28-ff88a1d7ec72 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:29.129479 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60d27c85-b44f-4cc1-9a28-ff88a1d7ec72 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:29.152309 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-60d27c85-b44f-4cc1-9a28-ff88a1d7ec72 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lazy-loading 'flavor' on Instance uuid cbed1ca6-db9b-4346-9edd-5047a3e302e7 {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:04:29.274525 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-60d27c85-b44f-4cc1-9a28-ff88a1d7ec72 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "POST /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7/action" status: 200 len: 32 microversion: 2.1 time: 0.157331 Dec 15 14:04:29.275197 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 119/246] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:29 2021] POST /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:04:29.284041 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3cbdcf39-b2cb-47f3-8eaa-4ecada075c05 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:29.284646 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3cbdcf39-b2cb-47f3-8eaa-4ecada075c05 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:29.291455 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3cbdcf39-b2cb-47f3-8eaa-4ecada075c05 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:29.291905 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3cbdcf39-b2cb-47f3-8eaa-4ecada075c05 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:29.292684 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3cbdcf39-b2cb-47f3-8eaa-4ecada075c05 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:29.293480 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3cbdcf39-b2cb-47f3-8eaa-4ecada075c05 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:29.335978 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8d773e65-5c9a-44ea-90e2-52b7700d7986 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:29.336773 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8d773e65-5c9a-44ea-90e2-52b7700d7986 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:29.343497 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8d773e65-5c9a-44ea-90e2-52b7700d7986 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:29.344372 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8d773e65-5c9a-44ea-90e2-52b7700d7986 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:29.345856 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8d773e65-5c9a-44ea-90e2-52b7700d7986 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:29.346361 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8d773e65-5c9a-44ea-90e2-52b7700d7986 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:29.670891 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3cbdcf39-b2cb-47f3-8eaa-4ecada075c05 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:29.678902 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3cbdcf39-b2cb-47f3-8eaa-4ecada075c05 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.398510 Dec 15 14:04:29.679417 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8d773e65-5c9a-44ea-90e2-52b7700d7986 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:29.683480 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 128/247] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:29 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:29.688856 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8d773e65-5c9a-44ea-90e2-52b7700d7986 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:29.689452 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-45e380eb-92a3-4742-8cd1-2f5ed2446a75 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:29.690080 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-45e380eb-92a3-4742-8cd1-2f5ed2446a75 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:29.690556 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8d773e65-5c9a-44ea-90e2-52b7700d7986 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:29.691720 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8d773e65-5c9a-44ea-90e2-52b7700d7986 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1597 microversion: 2.20 time: 0.360566 Dec 15 14:04:29.692433 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 120/248] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:04:29 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1597 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:04:29.696715 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-45e380eb-92a3-4742-8cd1-2f5ed2446a75 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:29.697354 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-45e380eb-92a3-4742-8cd1-2f5ed2446a75 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:29.698381 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-45e380eb-92a3-4742-8cd1-2f5ed2446a75 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:29.698952 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-45e380eb-92a3-4742-8cd1-2f5ed2446a75 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:29.713117 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cafae5dd-a7cb-4d17-b17c-12b84e50dd3b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:29.713553 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cafae5dd-a7cb-4d17-b17c-12b84e50dd3b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:29.728413 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cafae5dd-a7cb-4d17-b17c-12b84e50dd3b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:29.729105 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cafae5dd-a7cb-4d17-b17c-12b84e50dd3b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:29.730293 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cafae5dd-a7cb-4d17-b17c-12b84e50dd3b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:29.731005 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cafae5dd-a7cb-4d17-b17c-12b84e50dd3b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:30.170619 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cafae5dd-a7cb-4d17-b17c-12b84e50dd3b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.462845 Dec 15 14:04:30.171590 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 121/249] 10.222.0.42 () {60 vars in 1315 bytes} [Wed Dec 15 14:04:29 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/os-interface => generated 285 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:04:30.184311 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d01cf367-ea29-4f78-8f8c-1ab4486e2a38 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:30.185032 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d01cf367-ea29-4f78-8f8c-1ab4486e2a38 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:30.193120 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d01cf367-ea29-4f78-8f8c-1ab4486e2a38 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:30.193833 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d01cf367-ea29-4f78-8f8c-1ab4486e2a38 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:30.194769 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d01cf367-ea29-4f78-8f8c-1ab4486e2a38 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:30.195208 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d01cf367-ea29-4f78-8f8c-1ab4486e2a38 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:30.221496 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-45e380eb-92a3-4742-8cd1-2f5ed2446a75 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:30.234060 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-45e380eb-92a3-4742-8cd1-2f5ed2446a75 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1547 microversion: 2.1 time: 0.549033 Dec 15 14:04:30.234730 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 129/250] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:29 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1547 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:30.252805 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8f67fba7-4c13-433d-b6d5-98a76bf860be tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:30.253548 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8f67fba7-4c13-433d-b6d5-98a76bf860be tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:30.260638 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f67fba7-4c13-433d-b6d5-98a76bf860be tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:30.261176 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f67fba7-4c13-433d-b6d5-98a76bf860be tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:30.262075 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f67fba7-4c13-433d-b6d5-98a76bf860be tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:30.262601 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f67fba7-4c13-433d-b6d5-98a76bf860be tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:30.507858 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d01cf367-ea29-4f78-8f8c-1ab4486e2a38 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:30.515995 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d01cf367-ea29-4f78-8f8c-1ab4486e2a38 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1508 microversion: 2.1 time: 0.335693 Dec 15 14:04:30.516792 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 122/251] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:30 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1508 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:30.539683 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8f67fba7-4c13-433d-b6d5-98a76bf860be tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.291104 Dec 15 14:04:30.540287 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 130/252] 10.222.0.42 () {58 vars in 1274 bytes} [Wed Dec 15 14:04:30 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/os-interface => generated 284 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:04:30.695667 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8733d0dd-c761-4f41-ac4d-832f05aa382f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:30.696276 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8733d0dd-c761-4f41-ac4d-832f05aa382f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:30.716021 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8733d0dd-c761-4f41-ac4d-832f05aa382f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:30.716655 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8733d0dd-c761-4f41-ac4d-832f05aa382f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:30.717694 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8733d0dd-c761-4f41-ac4d-832f05aa382f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:30.718261 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8733d0dd-c761-4f41-ac4d-832f05aa382f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:30.996197 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8733d0dd-c761-4f41-ac4d-832f05aa382f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:31.003834 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8733d0dd-c761-4f41-ac4d-832f05aa382f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.311743 Dec 15 14:04:31.026012 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 123/253] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:30 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:32.026306 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b22b3ae9-9024-4a00-ad67-70ea873fb4b2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:32.027610 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b22b3ae9-9024-4a00-ad67-70ea873fb4b2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:32.038093 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b22b3ae9-9024-4a00-ad67-70ea873fb4b2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:32.038751 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b22b3ae9-9024-4a00-ad67-70ea873fb4b2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:32.039650 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b22b3ae9-9024-4a00-ad67-70ea873fb4b2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:32.040151 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b22b3ae9-9024-4a00-ad67-70ea873fb4b2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:32.244316 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c8dee0b3-2878-4009-aa9d-136625111f5e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:32.244987 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c8dee0b3-2878-4009-aa9d-136625111f5e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:32.261895 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c8dee0b3-2878-4009-aa9d-136625111f5e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:32.266381 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c8dee0b3-2878-4009-aa9d-136625111f5e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:32.268615 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c8dee0b3-2878-4009-aa9d-136625111f5e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:32.269276 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c8dee0b3-2878-4009-aa9d-136625111f5e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:32.318536 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b22b3ae9-9024-4a00-ad67-70ea873fb4b2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:32.332077 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c8dee0b3-2878-4009-aa9d-136625111f5e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:04:32.338303 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b22b3ae9-9024-4a00-ad67-70ea873fb4b2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.319148 Dec 15 14:04:32.339073 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 131/254] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:32 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:32.555871 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c8dee0b3-2878-4009-aa9d-136625111f5e tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 204 len: 0 microversion: 2.1 time: 0.315664 Dec 15 14:04:32.569382 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 124/255] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:04:32 2021] DELETE /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 14:04:32.579121 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-92617be5-d532-4c02-8fa7-733b08570cc4 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:32.580397 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-92617be5-d532-4c02-8fa7-733b08570cc4 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:32.588117 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92617be5-d532-4c02-8fa7-733b08570cc4 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:32.589034 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92617be5-d532-4c02-8fa7-733b08570cc4 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:32.590103 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92617be5-d532-4c02-8fa7-733b08570cc4 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:32.591206 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92617be5-d532-4c02-8fa7-733b08570cc4 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:32.778152 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-92617be5-d532-4c02-8fa7-733b08570cc4 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:32.784747 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-92617be5-d532-4c02-8fa7-733b08570cc4 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1555 microversion: 2.1 time: 0.210366 Dec 15 14:04:32.785648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 132/256] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:32 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1555 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:33.341255 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-158b64e5-341d-4a90-bf5a-14e4c475ecf2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:33.342358 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-158b64e5-341d-4a90-bf5a-14e4c475ecf2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:33.366610 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-11b69834-6dee-48d7-a2bf-bc16d6e0a5e9 req-2ed4a361-a412-48b4-82f8-0366a894a838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08832229-b545-4a06-a332-54ab9a72bacd", "tag": "96478e00-8427-434c-8484-2d9c25c7698e"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:33.368412 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-158b64e5-341d-4a90-bf5a-14e4c475ecf2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:33.369027 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-158b64e5-341d-4a90-bf5a-14e4c475ecf2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:33.369910 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-158b64e5-341d-4a90-bf5a-14e4c475ecf2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:33.370395 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-158b64e5-341d-4a90-bf5a-14e4c475ecf2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:33.376730 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:04:33.376730 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:04:33.398252 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-11b69834-6dee-48d7-a2bf-bc16d6e0a5e9 req-2ed4a361-a412-48b4-82f8-0366a894a838 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:33.398693 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-11b69834-6dee-48d7-a2bf-bc16d6e0a5e9 req-2ed4a361-a412-48b4-82f8-0366a894a838 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:33.433675 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-11b69834-6dee-48d7-a2bf-bc16d6e0a5e9 req-2ed4a361-a412-48b4-82f8-0366a894a838 service nova] Creating event network-changed:96478e00-8427-434c-8484-2d9c25c7698e for instance 08832229-b545-4a06-a332-54ab9a72bacd on hv-cinder-82182 Dec 15 14:04:33.445798 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-11b69834-6dee-48d7-a2bf-bc16d6e0a5e9 req-2ed4a361-a412-48b4-82f8-0366a894a838 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097430 Dec 15 14:04:33.449590 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 133/257] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:04:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:04:33.456114 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d6a0b0d3-5fb9-4586-8ad1-dc916bb90746 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:33.456900 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d6a0b0d3-5fb9-4586-8ad1-dc916bb90746 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:33.467480 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d6a0b0d3-5fb9-4586-8ad1-dc916bb90746 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:33.468188 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d6a0b0d3-5fb9-4586-8ad1-dc916bb90746 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:33.469220 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d6a0b0d3-5fb9-4586-8ad1-dc916bb90746 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:33.469895 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d6a0b0d3-5fb9-4586-8ad1-dc916bb90746 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:33.558962 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-158b64e5-341d-4a90-bf5a-14e4c475ecf2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 14 microversion: 2.1 time: 0.221954 Dec 15 14:04:33.559678 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 125/258] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:33 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 14 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:04:33.576993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-521b4bf8-20e9-4fca-a6e9-e87842c57617 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:33.580047 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-521b4bf8-20e9-4fca-a6e9-e87842c57617 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:33.610784 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-521b4bf8-20e9-4fca-a6e9-e87842c57617 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:33.612941 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-521b4bf8-20e9-4fca-a6e9-e87842c57617 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:33.617028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-521b4bf8-20e9-4fca-a6e9-e87842c57617 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:33.617953 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-521b4bf8-20e9-4fca-a6e9-e87842c57617 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:33.800906 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-521b4bf8-20e9-4fca-a6e9-e87842c57617 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 14 microversion: 2.20 time: 0.238257 Dec 15 14:04:33.801557 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 126/259] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:04:33 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 14 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:33.848515 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-730d8e4a-82cb-42ee-a314-f71bed86f61b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:33.849269 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-730d8e4a-82cb-42ee-a314-f71bed86f61b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:33.862901 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-730d8e4a-82cb-42ee-a314-f71bed86f61b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:33.869392 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-730d8e4a-82cb-42ee-a314-f71bed86f61b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:33.870467 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-730d8e4a-82cb-42ee-a314-f71bed86f61b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:33.871043 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-730d8e4a-82cb-42ee-a314-f71bed86f61b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:33.879998 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d6a0b0d3-5fb9-4586-8ad1-dc916bb90746 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:33.889073 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d6a0b0d3-5fb9-4586-8ad1-dc916bb90746 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.437389 Dec 15 14:04:33.891991 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 134/260] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:33 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:34.212949 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-730d8e4a-82cb-42ee-a314-f71bed86f61b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:34.225661 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-730d8e4a-82cb-42ee-a314-f71bed86f61b tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1555 microversion: 2.1 time: 0.382388 Dec 15 14:04:34.226461 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 127/261] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:33 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1555 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:34.572531 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e8770cbd-59e4-4c80-9e80-d7036cdc5d04 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:34.573760 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e8770cbd-59e4-4c80-9e80-d7036cdc5d04 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:34.589413 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8770cbd-59e4-4c80-9e80-d7036cdc5d04 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:34.590312 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8770cbd-59e4-4c80-9e80-d7036cdc5d04 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:34.593838 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8770cbd-59e4-4c80-9e80-d7036cdc5d04 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:34.594458 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8770cbd-59e4-4c80-9e80-d7036cdc5d04 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:34.815286 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fa5eb5bb-fc0a-4244-9c08-536cfa020f01 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:34.818291 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fa5eb5bb-fc0a-4244-9c08-536cfa020f01 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:34.840045 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e8770cbd-59e4-4c80-9e80-d7036cdc5d04 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 14 microversion: 2.1 time: 0.269239 Dec 15 14:04:34.842439 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 135/262] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:34 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 14 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:04:34.856203 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa5eb5bb-fc0a-4244-9c08-536cfa020f01 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:34.856719 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa5eb5bb-fc0a-4244-9c08-536cfa020f01 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:34.859512 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa5eb5bb-fc0a-4244-9c08-536cfa020f01 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:34.861094 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa5eb5bb-fc0a-4244-9c08-536cfa020f01 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:34.908673 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-917fb126-0117-4ea3-b2d0-e26f5a056639 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:34.909375 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-917fb126-0117-4ea3-b2d0-e26f5a056639 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:34.919886 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-917fb126-0117-4ea3-b2d0-e26f5a056639 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:34.920328 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-917fb126-0117-4ea3-b2d0-e26f5a056639 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:34.921122 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-917fb126-0117-4ea3-b2d0-e26f5a056639 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:34.930278 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-917fb126-0117-4ea3-b2d0-e26f5a056639 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:35.265635 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-917fb126-0117-4ea3-b2d0-e26f5a056639 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:35.280710 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-917fb126-0117-4ea3-b2d0-e26f5a056639 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.375924 Dec 15 14:04:35.294883 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 136/263] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:34 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:35.302322 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-67935536-d4d4-4b14-b66b-a0de0275598d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:35.305468 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-67935536-d4d4-4b14-b66b-a0de0275598d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:35.325948 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67935536-d4d4-4b14-b66b-a0de0275598d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:35.336984 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67935536-d4d4-4b14-b66b-a0de0275598d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:35.337465 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67935536-d4d4-4b14-b66b-a0de0275598d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:35.338065 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67935536-d4d4-4b14-b66b-a0de0275598d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:35.512677 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fa5eb5bb-fc0a-4244-9c08-536cfa020f01 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 14 microversion: 2.20 time: 0.703838 Dec 15 14:04:35.513510 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 128/264] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:04:34 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 14 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:35.528507 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-6c4d35ac-0542-4762-a54f-d84f407e1869 req-8c2e312a-1baf-417a-9a7f-1e9efd9b9395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc65306-f419-4eac-97a2-407c5d6744da", "tag": "7989001b-405b-4c40-b4ff-1aeb457e4e50"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:35.530068 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:04:35.530068 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:04:35.545879 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-6c4d35ac-0542-4762-a54f-d84f407e1869 req-8c2e312a-1baf-417a-9a7f-1e9efd9b9395 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:35.546616 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-6c4d35ac-0542-4762-a54f-d84f407e1869 req-8c2e312a-1baf-417a-9a7f-1e9efd9b9395 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:35.573322 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-6c4d35ac-0542-4762-a54f-d84f407e1869 req-8c2e312a-1baf-417a-9a7f-1e9efd9b9395 service nova] Creating event network-changed:7989001b-405b-4c40-b4ff-1aeb457e4e50 for instance fcc65306-f419-4eac-97a2-407c5d6744da on hv-cinder-82182 Dec 15 14:04:35.586472 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-6c4d35ac-0542-4762-a54f-d84f407e1869 req-8c2e312a-1baf-417a-9a7f-1e9efd9b9395 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071388 Dec 15 14:04:35.591853 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 129/265] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:04:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:04:35.738009 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-67935536-d4d4-4b14-b66b-a0de0275598d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:35.748116 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-67935536-d4d4-4b14-b66b-a0de0275598d tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1555 microversion: 2.1 time: 0.451570 Dec 15 14:04:35.748743 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 137/266] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:35 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1555 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:35.854035 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5081c3ad-0d69-4e0b-9175-73dc1a6557a0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:35.854976 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5081c3ad-0d69-4e0b-9175-73dc1a6557a0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:35.861414 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5081c3ad-0d69-4e0b-9175-73dc1a6557a0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:35.861885 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5081c3ad-0d69-4e0b-9175-73dc1a6557a0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:35.862669 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5081c3ad-0d69-4e0b-9175-73dc1a6557a0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:35.863098 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5081c3ad-0d69-4e0b-9175-73dc1a6557a0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:36.009828 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5081c3ad-0d69-4e0b-9175-73dc1a6557a0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 14 microversion: 2.1 time: 0.160565 Dec 15 14:04:36.010848 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 130/267] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:35 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:04:36.302093 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-58c6c156-1ac8-4d79-897f-da7266a82111 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:36.302924 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-58c6c156-1ac8-4d79-897f-da7266a82111 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:36.314474 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-58c6c156-1ac8-4d79-897f-da7266a82111 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:36.315211 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-58c6c156-1ac8-4d79-897f-da7266a82111 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:36.316635 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-58c6c156-1ac8-4d79-897f-da7266a82111 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:36.317632 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-58c6c156-1ac8-4d79-897f-da7266a82111 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:36.530700 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2b940df2-5bfd-4c97-a0e6-60e53e9d7615 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:36.532144 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2b940df2-5bfd-4c97-a0e6-60e53e9d7615 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:36.541798 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b940df2-5bfd-4c97-a0e6-60e53e9d7615 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:36.542431 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b940df2-5bfd-4c97-a0e6-60e53e9d7615 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:36.543377 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b940df2-5bfd-4c97-a0e6-60e53e9d7615 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:36.544014 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b940df2-5bfd-4c97-a0e6-60e53e9d7615 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:36.650053 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2b940df2-5bfd-4c97-a0e6-60e53e9d7615 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 14 microversion: 2.20 time: 0.124515 Dec 15 14:04:36.654017 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 131/268] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:04:36 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:36.768800 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c67cbb51-e5bd-4fcc-9699-cc2bacec14af tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:36.769975 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c67cbb51-e5bd-4fcc-9699-cc2bacec14af tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:36.783407 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c67cbb51-e5bd-4fcc-9699-cc2bacec14af tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:36.784025 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c67cbb51-e5bd-4fcc-9699-cc2bacec14af tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:36.786144 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c67cbb51-e5bd-4fcc-9699-cc2bacec14af tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:36.786789 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c67cbb51-e5bd-4fcc-9699-cc2bacec14af tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:37.047388 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-58c6c156-1ac8-4d79-897f-da7266a82111 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:37.060840 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-58c6c156-1ac8-4d79-897f-da7266a82111 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.764637 Dec 15 14:04:37.061429 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 138/269] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:36 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:37.066047 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e8d4e54a-5331-4e31-bd82-bfe3845be6fa tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:37.078928 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e8d4e54a-5331-4e31-bd82-bfe3845be6fa tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:37.086387 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8d4e54a-5331-4e31-bd82-bfe3845be6fa tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:37.086840 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8d4e54a-5331-4e31-bd82-bfe3845be6fa tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:37.087759 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8d4e54a-5331-4e31-bd82-bfe3845be6fa tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:37.088196 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8d4e54a-5331-4e31-bd82-bfe3845be6fa tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:37.235851 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e8d4e54a-5331-4e31-bd82-bfe3845be6fa tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 14 microversion: 2.1 time: 0.169690 Dec 15 14:04:37.237004 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 139/270] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:37 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:04:37.285792 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c67cbb51-e5bd-4fcc-9699-cc2bacec14af tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:37.297859 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c67cbb51-e5bd-4fcc-9699-cc2bacec14af tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1555 microversion: 2.1 time: 0.535352 Dec 15 14:04:37.300749 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 132/271] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:36 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1555 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:37.556999 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-bd768a88-1db7-41d1-84b7-42c5b70b204e req-ed623407-5ea1-4b1b-a90f-186ab8702ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f68da2b-2ed8-4892-85a6-1612edd7b6fc", "name": "network-vif-deleted", "tag": "223697b4-2610-4672-9cd7-955d6898e0bb"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:37.561122 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:04:37.561122 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:04:37.573321 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-bd768a88-1db7-41d1-84b7-42c5b70b204e req-ed623407-5ea1-4b1b-a90f-186ab8702ace service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:37.574192 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-bd768a88-1db7-41d1-84b7-42c5b70b204e req-ed623407-5ea1-4b1b-a90f-186ab8702ace service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:37.606729 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-bd768a88-1db7-41d1-84b7-42c5b70b204e req-ed623407-5ea1-4b1b-a90f-186ab8702ace service nova] Creating event network-vif-deleted:223697b4-2610-4672-9cd7-955d6898e0bb for instance 3f68da2b-2ed8-4892-85a6-1612edd7b6fc on hv-cinder-82182 Dec 15 14:04:37.612171 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-bd768a88-1db7-41d1-84b7-42c5b70b204e req-ed623407-5ea1-4b1b-a90f-186ab8702ace service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067602 Dec 15 14:04:37.612889 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 140/272] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:04:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:04:37.663647 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-803eb4a8-cb2f-4aa5-8313-c8847cebd92e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:37.664598 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-803eb4a8-cb2f-4aa5-8313-c8847cebd92e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:37.674209 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-803eb4a8-cb2f-4aa5-8313-c8847cebd92e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:37.675055 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-803eb4a8-cb2f-4aa5-8313-c8847cebd92e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:37.676700 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-803eb4a8-cb2f-4aa5-8313-c8847cebd92e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:37.677439 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-803eb4a8-cb2f-4aa5-8313-c8847cebd92e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:37.776764 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-803eb4a8-cb2f-4aa5-8313-c8847cebd92e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 14 microversion: 2.20 time: 0.116920 Dec 15 14:04:37.781296 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 133/273] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:04:37 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:38.080870 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a6c749b8-659d-42e9-b1c5-166f258e666c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:38.081987 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a6c749b8-659d-42e9-b1c5-166f258e666c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:38.088755 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a6c749b8-659d-42e9-b1c5-166f258e666c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:38.091535 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a6c749b8-659d-42e9-b1c5-166f258e666c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:38.093043 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a6c749b8-659d-42e9-b1c5-166f258e666c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:38.093713 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a6c749b8-659d-42e9-b1c5-166f258e666c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:38.248968 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ec886a64-0c28-456f-b5b9-d61a82eb28c3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:38.250053 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ec886a64-0c28-456f-b5b9-d61a82eb28c3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:38.257574 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ec886a64-0c28-456f-b5b9-d61a82eb28c3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:38.258246 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ec886a64-0c28-456f-b5b9-d61a82eb28c3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:38.259183 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ec886a64-0c28-456f-b5b9-d61a82eb28c3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:38.259753 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ec886a64-0c28-456f-b5b9-d61a82eb28c3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:38.380441 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ec886a64-0c28-456f-b5b9-d61a82eb28c3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 14 microversion: 2.1 time: 0.136819 Dec 15 14:04:38.381162 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 134/274] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:38 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:04:38.390261 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-881589ec-1215-4b42-8664-2bf29d962587 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:38.390957 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-881589ec-1215-4b42-8664-2bf29d962587 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:38.399590 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-881589ec-1215-4b42-8664-2bf29d962587 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:38.406691 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-881589ec-1215-4b42-8664-2bf29d962587 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:38.407567 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-881589ec-1215-4b42-8664-2bf29d962587 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:38.408141 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-881589ec-1215-4b42-8664-2bf29d962587 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:38.415385 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a6c749b8-659d-42e9-b1c5-166f258e666c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:38.426336 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a6c749b8-659d-42e9-b1c5-166f258e666c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.349455 Dec 15 14:04:38.427139 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 141/275] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:38 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:38.461240 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-881589ec-1215-4b42-8664-2bf29d962587 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:38.461895 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-881589ec-1215-4b42-8664-2bf29d962587 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:38.462474 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-881589ec-1215-4b42-8664-2bf29d962587 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lazy-loading 'fault' on Instance uuid 3f68da2b-2ed8-4892-85a6-1612edd7b6fc {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:04:38.555818 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-881589ec-1215-4b42-8664-2bf29d962587 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30e805583648f1a7580b8c378163aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6983fc3490f4adca748ac8a66d65c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:38.566241 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-881589ec-1215-4b42-8664-2bf29d962587 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 200 len: 1351 microversion: 2.1 time: 0.183875 Dec 15 14:04:38.566838 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 135/276] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:38 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 1351 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:38.788650 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fefd02e3-018d-47fc-ab87-e4886bdfb214 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:38.789583 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fefd02e3-018d-47fc-ab87-e4886bdfb214 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:38.804463 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fefd02e3-018d-47fc-ab87-e4886bdfb214 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:38.805121 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fefd02e3-018d-47fc-ab87-e4886bdfb214 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:38.806095 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fefd02e3-018d-47fc-ab87-e4886bdfb214 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:38.806679 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fefd02e3-018d-47fc-ab87-e4886bdfb214 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:38.948122 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fefd02e3-018d-47fc-ab87-e4886bdfb214 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 14 microversion: 2.20 time: 0.163166 Dec 15 14:04:38.949188 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 142/277] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:04:38 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:39.392187 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-98fe4fce-c51a-4b50-a529-f5b6b3e0c911 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:39.393111 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-98fe4fce-c51a-4b50-a529-f5b6b3e0c911 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:39.401389 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-98fe4fce-c51a-4b50-a529-f5b6b3e0c911 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:39.401953 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-98fe4fce-c51a-4b50-a529-f5b6b3e0c911 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:39.402747 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-98fe4fce-c51a-4b50-a529-f5b6b3e0c911 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:39.403184 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-98fe4fce-c51a-4b50-a529-f5b6b3e0c911 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:39.448526 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-710758a7-7c62-459c-8d87-f31931bead32 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:39.449281 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-710758a7-7c62-459c-8d87-f31931bead32 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:39.461231 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-710758a7-7c62-459c-8d87-f31931bead32 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:39.461696 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-710758a7-7c62-459c-8d87-f31931bead32 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:39.462497 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-710758a7-7c62-459c-8d87-f31931bead32 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:39.463062 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-710758a7-7c62-459c-8d87-f31931bead32 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:39.536998 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-98fe4fce-c51a-4b50-a529-f5b6b3e0c911 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 14 microversion: 2.1 time: 0.148265 Dec 15 14:04:39.541749 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 136/278] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:39 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:04:39.584446 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5a4a59a9-dac4-4f4a-b6af-68cd2b2dca81 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:39.585420 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5a4a59a9-dac4-4f4a-b6af-68cd2b2dca81 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:39.593210 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a4a59a9-dac4-4f4a-b6af-68cd2b2dca81 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:39.593804 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a4a59a9-dac4-4f4a-b6af-68cd2b2dca81 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:39.594675 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a4a59a9-dac4-4f4a-b6af-68cd2b2dca81 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:39.595370 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a4a59a9-dac4-4f4a-b6af-68cd2b2dca81 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:39.611526 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-710758a7-7c62-459c-8d87-f31931bead32 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:39.611960 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-5a4a59a9-dac4-4f4a-b6af-68cd2b2dca81 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] HTTP exception thrown: Instance 3f68da2b-2ed8-4892-85a6-1612edd7b6fc could not be found. Dec 15 14:04:39.612560 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5a4a59a9-dac4-4f4a-b6af-68cd2b2dca81 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Returning 404 to user: Instance 3f68da2b-2ed8-4892-85a6-1612edd7b6fc could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:04:39.613398 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5a4a59a9-dac4-4f4a-b6af-68cd2b2dca81 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 404 len: 111 microversion: 2.1 time: 0.033419 Dec 15 14:04:39.614149 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 137/279] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:39 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 14:04:39.623192 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-710758a7-7c62-459c-8d87-f31931bead32 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.182463 Dec 15 14:04:39.624062 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 143/280] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:39 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:39.729953 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d5089bcf-5fac-46b8-bad3-564a58285824 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:39.731124 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d5089bcf-5fac-46b8-bad3-564a58285824 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:39.738165 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5089bcf-5fac-46b8-bad3-564a58285824 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:39.738614 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5089bcf-5fac-46b8-bad3-564a58285824 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:39.739398 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5089bcf-5fac-46b8-bad3-564a58285824 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:39.739828 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5089bcf-5fac-46b8-bad3-564a58285824 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:39.752877 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-d5089bcf-5fac-46b8-bad3-564a58285824 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] HTTP exception thrown: Instance 3f68da2b-2ed8-4892-85a6-1612edd7b6fc could not be found. Dec 15 14:04:39.753452 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d5089bcf-5fac-46b8-bad3-564a58285824 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Returning 404 to user: Instance 3f68da2b-2ed8-4892-85a6-1612edd7b6fc could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:04:39.754417 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d5089bcf-5fac-46b8-bad3-564a58285824 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028166 Dec 15 14:04:39.754964 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 138/281] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Dec 15 14:04:39 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:04:39.959340 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-603c0f59-2717-4d97-9408-814250a40170 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:39.960363 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-603c0f59-2717-4d97-9408-814250a40170 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:39.967638 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-603c0f59-2717-4d97-9408-814250a40170 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:39.968084 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-603c0f59-2717-4d97-9408-814250a40170 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:39.969453 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-603c0f59-2717-4d97-9408-814250a40170 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:39.970363 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-603c0f59-2717-4d97-9408-814250a40170 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:40.106979 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-603c0f59-2717-4d97-9408-814250a40170 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 14 microversion: 2.20 time: 0.151163 Dec 15 14:04:40.107693 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 144/282] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:04:39 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:40.548710 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-198f1953-1978-4dad-b799-e75cc6d8526f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:40.549832 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-198f1953-1978-4dad-b799-e75cc6d8526f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:40.558310 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-198f1953-1978-4dad-b799-e75cc6d8526f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:40.558975 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-198f1953-1978-4dad-b799-e75cc6d8526f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:40.563898 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-198f1953-1978-4dad-b799-e75cc6d8526f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:40.564655 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-198f1953-1978-4dad-b799-e75cc6d8526f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:40.640866 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ed58e685-3e7f-47ca-beb9-01b2f499d390 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:40.641571 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ed58e685-3e7f-47ca-beb9-01b2f499d390 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:40.648601 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed58e685-3e7f-47ca-beb9-01b2f499d390 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:40.649062 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed58e685-3e7f-47ca-beb9-01b2f499d390 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:40.649885 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed58e685-3e7f-47ca-beb9-01b2f499d390 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:40.650445 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed58e685-3e7f-47ca-beb9-01b2f499d390 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:40.668228 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-198f1953-1978-4dad-b799-e75cc6d8526f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 14 microversion: 2.1 time: 0.123347 Dec 15 14:04:40.669047 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 139/283] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:40 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:04:40.803173 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ed58e685-3e7f-47ca-beb9-01b2f499d390 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:40.811301 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ed58e685-3e7f-47ca-beb9-01b2f499d390 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.174715 Dec 15 14:04:40.812558 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 145/284] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:40 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:41.119529 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b93cfd95-e31b-44c6-9eb3-1d5efaa8cd4d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:41.120751 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b93cfd95-e31b-44c6-9eb3-1d5efaa8cd4d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:41.134669 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b93cfd95-e31b-44c6-9eb3-1d5efaa8cd4d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:41.135793 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b93cfd95-e31b-44c6-9eb3-1d5efaa8cd4d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:41.136751 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b93cfd95-e31b-44c6-9eb3-1d5efaa8cd4d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:41.137419 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b93cfd95-e31b-44c6-9eb3-1d5efaa8cd4d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:41.201127 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d7dd8d76-c842-4231-bc16-8e91421d3ba5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:41.201735 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d7dd8d76-c842-4231-bc16-8e91421d3ba5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:41.207895 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7dd8d76-c842-4231-bc16-8e91421d3ba5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:41.208404 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7dd8d76-c842-4231-bc16-8e91421d3ba5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:41.209431 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7dd8d76-c842-4231-bc16-8e91421d3ba5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:41.210054 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7dd8d76-c842-4231-bc16-8e91421d3ba5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:41.225812 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-d7dd8d76-c842-4231-bc16-8e91421d3ba5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] HTTP exception thrown: Instance 3f68da2b-2ed8-4892-85a6-1612edd7b6fc could not be found. Dec 15 14:04:41.226401 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d7dd8d76-c842-4231-bc16-8e91421d3ba5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Returning 404 to user: Instance 3f68da2b-2ed8-4892-85a6-1612edd7b6fc could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:04:41.227861 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d7dd8d76-c842-4231-bc16-8e91421d3ba5 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 404 len: 111 microversion: 2.1 time: 0.030971 Dec 15 14:04:41.228884 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 146/285] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:04:41 2021] DELETE /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:04:41.238397 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-68b52b51-d025-49c9-91f3-bb457aff8810 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:41.239170 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-68b52b51-d025-49c9-91f3-bb457aff8810 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] [instance: 3f68da2b-2ed8-4892-85a6-1612edd7b6fc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:41.246001 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68b52b51-d025-49c9-91f3-bb457aff8810 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:41.246376 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68b52b51-d025-49c9-91f3-bb457aff8810 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:41.247150 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68b52b51-d025-49c9-91f3-bb457aff8810 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:41.247573 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68b52b51-d025-49c9-91f3-bb457aff8810 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:41.261361 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-68b52b51-d025-49c9-91f3-bb457aff8810 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] HTTP exception thrown: Instance 3f68da2b-2ed8-4892-85a6-1612edd7b6fc could not be found. Dec 15 14:04:41.261984 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-68b52b51-d025-49c9-91f3-bb457aff8810 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] Returning 404 to user: Instance 3f68da2b-2ed8-4892-85a6-1612edd7b6fc could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:04:41.262844 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-68b52b51-d025-49c9-91f3-bb457aff8810 tempest-DeleteServersTestJSON-1316705436 tempest-DeleteServersTestJSON-1316705436-project] 10.222.0.42 "GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc" status: 404 len: 111 microversion: 2.1 time: 0.028424 Dec 15 14:04:41.263654 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 147/286] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:41 2021] GET /compute/v2.1/servers/3f68da2b-2ed8-4892-85a6-1612edd7b6fc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:04:41.275479 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b93cfd95-e31b-44c6-9eb3-1d5efaa8cd4d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 14 microversion: 2.20 time: 0.160820 Dec 15 14:04:41.276706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 140/287] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:04:41 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:41.680076 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b7b0fd18-ddaf-43ed-b06f-133ad88fdfdd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:41.681053 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b7b0fd18-ddaf-43ed-b06f-133ad88fdfdd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:41.687686 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7b0fd18-ddaf-43ed-b06f-133ad88fdfdd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:41.688679 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7b0fd18-ddaf-43ed-b06f-133ad88fdfdd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:41.690512 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7b0fd18-ddaf-43ed-b06f-133ad88fdfdd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:41.691144 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7b0fd18-ddaf-43ed-b06f-133ad88fdfdd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:41.799641 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b7b0fd18-ddaf-43ed-b06f-133ad88fdfdd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 14 microversion: 2.1 time: 0.123136 Dec 15 14:04:41.802964 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 148/288] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:41 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:04:41.832215 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3111d848-5c90-403e-82b4-f6df03c1a1cf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:41.833703 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3111d848-5c90-403e-82b4-f6df03c1a1cf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:41.847393 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3111d848-5c90-403e-82b4-f6df03c1a1cf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:41.848068 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3111d848-5c90-403e-82b4-f6df03c1a1cf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:41.849196 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3111d848-5c90-403e-82b4-f6df03c1a1cf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:41.850179 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3111d848-5c90-403e-82b4-f6df03c1a1cf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:42.022625 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3111d848-5c90-403e-82b4-f6df03c1a1cf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:42.030871 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3111d848-5c90-403e-82b4-f6df03c1a1cf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.205919 Dec 15 14:04:42.031454 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 141/289] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:41 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:42.291620 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-83d39f72-031e-422a-8402-d27e9c2c8f99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:42.293106 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-83d39f72-031e-422a-8402-d27e9c2c8f99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:42.302668 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83d39f72-031e-422a-8402-d27e9c2c8f99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:42.303265 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83d39f72-031e-422a-8402-d27e9c2c8f99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:42.304223 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83d39f72-031e-422a-8402-d27e9c2c8f99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:42.304694 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83d39f72-031e-422a-8402-d27e9c2c8f99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:42.435164 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-83d39f72-031e-422a-8402-d27e9c2c8f99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 14 microversion: 2.20 time: 0.149887 Dec 15 14:04:42.439424 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 149/290] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:04:42 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:42.812635 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d71a46be-061b-4abb-a2ea-f9f21025fca1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:42.814072 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d71a46be-061b-4abb-a2ea-f9f21025fca1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:42.823438 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d71a46be-061b-4abb-a2ea-f9f21025fca1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:42.823968 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d71a46be-061b-4abb-a2ea-f9f21025fca1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:42.825784 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d71a46be-061b-4abb-a2ea-f9f21025fca1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:42.826227 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d71a46be-061b-4abb-a2ea-f9f21025fca1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:42.952655 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d71a46be-061b-4abb-a2ea-f9f21025fca1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 14 microversion: 2.1 time: 0.145358 Dec 15 14:04:42.960965 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 142/291] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:42 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:04:43.047781 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c033aee9-966b-4822-a06b-a867f18bd0e4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:43.049237 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c033aee9-966b-4822-a06b-a867f18bd0e4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:43.058166 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c033aee9-966b-4822-a06b-a867f18bd0e4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:43.058905 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c033aee9-966b-4822-a06b-a867f18bd0e4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:43.060448 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c033aee9-966b-4822-a06b-a867f18bd0e4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:43.061351 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c033aee9-966b-4822-a06b-a867f18bd0e4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:43.218638 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c033aee9-966b-4822-a06b-a867f18bd0e4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:43.226404 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c033aee9-966b-4822-a06b-a867f18bd0e4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.183046 Dec 15 14:04:43.226971 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 150/292] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:43 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:43.446863 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-03e23542-1de1-47c0-bad1-cf3336b4b02b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:43.447923 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-03e23542-1de1-47c0-bad1-cf3336b4b02b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:43.455592 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03e23542-1de1-47c0-bad1-cf3336b4b02b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:43.456357 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03e23542-1de1-47c0-bad1-cf3336b4b02b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:43.457160 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03e23542-1de1-47c0-bad1-cf3336b4b02b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:43.457641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03e23542-1de1-47c0-bad1-cf3336b4b02b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:43.964253 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-176a852b-38f4-47c6-a449-327389e0909f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:43.965192 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-176a852b-38f4-47c6-a449-327389e0909f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:43.971732 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-176a852b-38f4-47c6-a449-327389e0909f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:43.972391 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-176a852b-38f4-47c6-a449-327389e0909f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:43.973363 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-176a852b-38f4-47c6-a449-327389e0909f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:43.973968 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-176a852b-38f4-47c6-a449-327389e0909f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:48.276255 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-03e23542-1de1-47c0-bad1-cf3336b4b02b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 14 microversion: 2.20 time: 4.833121 Dec 15 14:04:48.277351 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 143/293] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:04:43 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 14 bytes in 4836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:04:48.285520 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-39d89733-1353-415f-b754-946354041fcf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:48.286697 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-39d89733-1353-415f-b754-946354041fcf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:48.294652 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39d89733-1353-415f-b754-946354041fcf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:48.295098 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39d89733-1353-415f-b754-946354041fcf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:48.295886 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39d89733-1353-415f-b754-946354041fcf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:48.296323 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39d89733-1353-415f-b754-946354041fcf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:48.441962 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-39d89733-1353-415f-b754-946354041fcf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:48.449932 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-39d89733-1353-415f-b754-946354041fcf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.170586 Dec 15 14:04:48.450702 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 144/294] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:48 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:48.622829 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-176a852b-38f4-47c6-a449-327389e0909f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 14 microversion: 2.1 time: 4.661823 Dec 15 14:04:48.623289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 151/295] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:43 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 14 bytes in 4663 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:04:49.292201 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-28cfbf3e-4755-4fa7-a545-b6efe2f82d52 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:49.293236 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-28cfbf3e-4755-4fa7-a545-b6efe2f82d52 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:49.300486 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-28cfbf3e-4755-4fa7-a545-b6efe2f82d52 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:49.300960 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-28cfbf3e-4755-4fa7-a545-b6efe2f82d52 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:49.301906 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-28cfbf3e-4755-4fa7-a545-b6efe2f82d52 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:49.302374 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-28cfbf3e-4755-4fa7-a545-b6efe2f82d52 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:49.388734 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-28cfbf3e-4755-4fa7-a545-b6efe2f82d52 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 14 microversion: 2.20 time: 0.101526 Dec 15 14:04:49.389579 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 145/296] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:04:49 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:49.468715 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-320b733b-6c0a-4599-b9e4-cf4fb0e3126a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:49.469653 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-320b733b-6c0a-4599-b9e4-cf4fb0e3126a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:49.477539 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-320b733b-6c0a-4599-b9e4-cf4fb0e3126a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:49.478126 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-320b733b-6c0a-4599-b9e4-cf4fb0e3126a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:49.478960 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-320b733b-6c0a-4599-b9e4-cf4fb0e3126a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:49.479867 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-320b733b-6c0a-4599-b9e4-cf4fb0e3126a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:49.636957 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-85d20f91-0d01-4ae3-9d49-55fb3ac279b2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:49.638023 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-85d20f91-0d01-4ae3-9d49-55fb3ac279b2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:49.640292 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-320b733b-6c0a-4599-b9e4-cf4fb0e3126a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:49.644915 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85d20f91-0d01-4ae3-9d49-55fb3ac279b2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:49.645364 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85d20f91-0d01-4ae3-9d49-55fb3ac279b2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:49.646175 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85d20f91-0d01-4ae3-9d49-55fb3ac279b2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:49.646916 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85d20f91-0d01-4ae3-9d49-55fb3ac279b2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:49.652443 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-320b733b-6c0a-4599-b9e4-cf4fb0e3126a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.186377 Dec 15 14:04:49.661773 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 152/297] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:49 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:49.747263 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-85d20f91-0d01-4ae3-9d49-55fb3ac279b2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 14 microversion: 2.1 time: 0.114176 Dec 15 14:04:49.748024 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 146/298] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:49 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:04:50.401396 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d77938bd-e19b-4472-b1f5-7cafd414235c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:50.402349 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d77938bd-e19b-4472-b1f5-7cafd414235c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:50.409239 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d77938bd-e19b-4472-b1f5-7cafd414235c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:50.409736 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d77938bd-e19b-4472-b1f5-7cafd414235c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:50.410520 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d77938bd-e19b-4472-b1f5-7cafd414235c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:50.410953 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d77938bd-e19b-4472-b1f5-7cafd414235c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:50.496414 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d77938bd-e19b-4472-b1f5-7cafd414235c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 14 microversion: 2.20 time: 0.099585 Dec 15 14:04:50.499017 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 153/299] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:04:50 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:50.670553 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7b3f1b49-bab9-4447-808c-1cb5a026de13 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:50.671251 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7b3f1b49-bab9-4447-808c-1cb5a026de13 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:50.678618 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b3f1b49-bab9-4447-808c-1cb5a026de13 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:50.686206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b3f1b49-bab9-4447-808c-1cb5a026de13 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:50.686206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b3f1b49-bab9-4447-808c-1cb5a026de13 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:50.686206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b3f1b49-bab9-4447-808c-1cb5a026de13 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:50.758489 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-00db4895-4ee1-4eeb-acae-a9b4c9c7d879 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:50.760348 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-00db4895-4ee1-4eeb-acae-a9b4c9c7d879 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:50.768168 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00db4895-4ee1-4eeb-acae-a9b4c9c7d879 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:50.768819 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00db4895-4ee1-4eeb-acae-a9b4c9c7d879 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:50.769645 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00db4895-4ee1-4eeb-acae-a9b4c9c7d879 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:50.770069 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00db4895-4ee1-4eeb-acae-a9b4c9c7d879 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:50.827788 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7b3f1b49-bab9-4447-808c-1cb5a026de13 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:50.836407 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7b3f1b49-bab9-4447-808c-1cb5a026de13 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.169927 Dec 15 14:04:50.837220 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 147/300] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:50 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:50.891531 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-00db4895-4ee1-4eeb-acae-a9b4c9c7d879 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 14 microversion: 2.1 time: 0.137400 Dec 15 14:04:50.895682 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 154/301] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:50 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:04:51.507880 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-71b3ed1a-53ef-404c-9227-d1372c652a44 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:51.508822 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-71b3ed1a-53ef-404c-9227-d1372c652a44 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:51.515234 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71b3ed1a-53ef-404c-9227-d1372c652a44 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:51.515680 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71b3ed1a-53ef-404c-9227-d1372c652a44 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:51.516462 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71b3ed1a-53ef-404c-9227-d1372c652a44 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:51.516884 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71b3ed1a-53ef-404c-9227-d1372c652a44 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:51.664294 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-71b3ed1a-53ef-404c-9227-d1372c652a44 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 4648 microversion: 2.20 time: 0.160475 Dec 15 14:04:51.665418 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 148/302] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:04:51 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 4648 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:04:51.856291 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f352c3b6-477e-4b50-bb44-0e045b1c0ce9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:51.857183 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f352c3b6-477e-4b50-bb44-0e045b1c0ce9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:51.866246 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f352c3b6-477e-4b50-bb44-0e045b1c0ce9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:51.867018 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f352c3b6-477e-4b50-bb44-0e045b1c0ce9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:51.868247 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f352c3b6-477e-4b50-bb44-0e045b1c0ce9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:51.868680 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f352c3b6-477e-4b50-bb44-0e045b1c0ce9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:51.909025 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-190cc7e0-05c4-4af9-9ccf-aa1236b115cc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:51.910248 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-190cc7e0-05c4-4af9-9ccf-aa1236b115cc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:51.919757 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-190cc7e0-05c4-4af9-9ccf-aa1236b115cc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:51.920641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-190cc7e0-05c4-4af9-9ccf-aa1236b115cc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:51.921701 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-190cc7e0-05c4-4af9-9ccf-aa1236b115cc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:51.922355 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-190cc7e0-05c4-4af9-9ccf-aa1236b115cc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:52.030535 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f352c3b6-477e-4b50-bb44-0e045b1c0ce9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:52.040504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-190cc7e0-05c4-4af9-9ccf-aa1236b115cc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 6451 microversion: 2.1 time: 0.140611 Dec 15 14:04:52.040752 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f352c3b6-477e-4b50-bb44-0e045b1c0ce9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.190384 Dec 15 14:04:52.045713 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 149/303] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:51 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 6451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:52.054881 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 155/304] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:51 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:52.676654 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ae81d473-9076-4426-8a03-d96e140ae9cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:52.678024 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ae81d473-9076-4426-8a03-d96e140ae9cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:52.685288 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ae81d473-9076-4426-8a03-d96e140ae9cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:52.685883 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ae81d473-9076-4426-8a03-d96e140ae9cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:52.687087 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ae81d473-9076-4426-8a03-d96e140ae9cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:52.687835 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ae81d473-9076-4426-8a03-d96e140ae9cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:52.808324 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ae81d473-9076-4426-8a03-d96e140ae9cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 8229 microversion: 2.20 time: 0.135439 Dec 15 14:04:52.809466 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 150/305] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:04:52 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 8229 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:04:53.052272 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-88b08dea-a30f-463f-9a37-b358af3d6a9a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:53.053426 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-88b08dea-a30f-463f-9a37-b358af3d6a9a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:53.063834 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88b08dea-a30f-463f-9a37-b358af3d6a9a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:53.064284 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88b08dea-a30f-463f-9a37-b358af3d6a9a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:53.064514 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b10c6582-f062-446d-a048-1a5eb5d7bd8e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:53.065763 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b10c6582-f062-446d-a048-1a5eb5d7bd8e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:53.067647 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88b08dea-a30f-463f-9a37-b358af3d6a9a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:53.068147 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88b08dea-a30f-463f-9a37-b358af3d6a9a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:53.075392 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b10c6582-f062-446d-a048-1a5eb5d7bd8e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:53.076188 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b10c6582-f062-446d-a048-1a5eb5d7bd8e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:53.077206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b10c6582-f062-446d-a048-1a5eb5d7bd8e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:53.077911 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b10c6582-f062-446d-a048-1a5eb5d7bd8e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:53.197176 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-88b08dea-a30f-463f-9a37-b358af3d6a9a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 9491 microversion: 2.1 time: 0.148137 Dec 15 14:04:53.198247 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 156/306] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:53 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 9491 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:53.313094 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b10c6582-f062-446d-a048-1a5eb5d7bd8e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:53.323930 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b10c6582-f062-446d-a048-1a5eb5d7bd8e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.262739 Dec 15 14:04:53.324784 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 151/307] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:53 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:53.825669 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-06504a12-7f0f-49cf-a459-f99fc806a7b3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:53.825669 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-06504a12-7f0f-49cf-a459-f99fc806a7b3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:53.845324 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06504a12-7f0f-49cf-a459-f99fc806a7b3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:53.845963 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06504a12-7f0f-49cf-a459-f99fc806a7b3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:53.847164 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06504a12-7f0f-49cf-a459-f99fc806a7b3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:53.847675 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06504a12-7f0f-49cf-a459-f99fc806a7b3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:54.009338 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-06504a12-7f0f-49cf-a459-f99fc806a7b3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 12882 microversion: 2.20 time: 0.190491 Dec 15 14:04:54.010033 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 157/308] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:04:53 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 12882 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:04:54.213026 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9d6efb48-2111-4bad-985f-492fcd15960e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:54.214137 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9d6efb48-2111-4bad-985f-492fcd15960e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:54.223216 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d6efb48-2111-4bad-985f-492fcd15960e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:54.224573 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d6efb48-2111-4bad-985f-492fcd15960e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:54.226290 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d6efb48-2111-4bad-985f-492fcd15960e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:54.227308 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d6efb48-2111-4bad-985f-492fcd15960e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:54.342893 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-82608c4b-0c62-4b68-b635-39b3184a6715 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:54.344310 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-82608c4b-0c62-4b68-b635-39b3184a6715 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:54.351938 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-82608c4b-0c62-4b68-b635-39b3184a6715 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:54.353518 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-82608c4b-0c62-4b68-b635-39b3184a6715 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:54.353518 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-82608c4b-0c62-4b68-b635-39b3184a6715 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:54.353825 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-82608c4b-0c62-4b68-b635-39b3184a6715 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:54.374465 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9d6efb48-2111-4bad-985f-492fcd15960e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 13436 microversion: 2.1 time: 0.168794 Dec 15 14:04:54.379289 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 152/309] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:54 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 13436 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:04:54.535580 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-82608c4b-0c62-4b68-b635-39b3184a6715 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:54.545846 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-82608c4b-0c62-4b68-b635-39b3184a6715 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.206733 Dec 15 14:04:54.546463 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 158/310] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:54 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:55.025587 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-23afc456-3985-44de-b787-b6c4217f155c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:55.027183 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-23afc456-3985-44de-b787-b6c4217f155c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:55.035477 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-23afc456-3985-44de-b787-b6c4217f155c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:55.036321 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-23afc456-3985-44de-b787-b6c4217f155c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:55.037387 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-23afc456-3985-44de-b787-b6c4217f155c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:55.038121 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-23afc456-3985-44de-b787-b6c4217f155c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:55.141326 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-23afc456-3985-44de-b787-b6c4217f155c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 16235 microversion: 2.20 time: 0.122396 Dec 15 14:04:55.142387 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 153/311] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:04:55 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 16235 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:04:55.386551 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-53bf26af-50fd-4a49-b0b8-d904cd4490a7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:55.387554 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-53bf26af-50fd-4a49-b0b8-d904cd4490a7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:55.396386 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53bf26af-50fd-4a49-b0b8-d904cd4490a7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:55.396831 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53bf26af-50fd-4a49-b0b8-d904cd4490a7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:55.397720 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53bf26af-50fd-4a49-b0b8-d904cd4490a7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:55.399038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53bf26af-50fd-4a49-b0b8-d904cd4490a7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:55.543588 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-53bf26af-50fd-4a49-b0b8-d904cd4490a7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 15531 microversion: 2.1 time: 0.160831 Dec 15 14:04:55.544758 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 159/312] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:55 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 15531 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:04:55.563158 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d670c361-ea0a-4fc5-a1fe-56d814992f4d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:55.563878 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d670c361-ea0a-4fc5-a1fe-56d814992f4d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:55.572130 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d670c361-ea0a-4fc5-a1fe-56d814992f4d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:55.572662 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d670c361-ea0a-4fc5-a1fe-56d814992f4d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:55.574233 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d670c361-ea0a-4fc5-a1fe-56d814992f4d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:55.575244 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d670c361-ea0a-4fc5-a1fe-56d814992f4d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:55.748260 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d670c361-ea0a-4fc5-a1fe-56d814992f4d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:55.756145 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d670c361-ea0a-4fc5-a1fe-56d814992f4d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.197053 Dec 15 14:04:55.757278 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 154/313] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:55 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:56.162886 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9c31c48c-47a3-4d4f-9c98-f909fbd3dfad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:56.163801 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9c31c48c-47a3-4d4f-9c98-f909fbd3dfad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:56.171198 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c31c48c-47a3-4d4f-9c98-f909fbd3dfad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:56.171890 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c31c48c-47a3-4d4f-9c98-f909fbd3dfad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:56.172914 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c31c48c-47a3-4d4f-9c98-f909fbd3dfad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:56.173493 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c31c48c-47a3-4d4f-9c98-f909fbd3dfad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:56.304302 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9c31c48c-47a3-4d4f-9c98-f909fbd3dfad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 17686 microversion: 2.20 time: 0.154677 Dec 15 14:04:56.305797 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 160/314] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:04:56 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 17686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:04:56.555263 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f873b4b1-9422-43cd-89c0-246d964c5472 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:56.556203 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f873b4b1-9422-43cd-89c0-246d964c5472 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:56.562258 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f873b4b1-9422-43cd-89c0-246d964c5472 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:56.562695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f873b4b1-9422-43cd-89c0-246d964c5472 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:56.563713 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f873b4b1-9422-43cd-89c0-246d964c5472 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:56.564769 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f873b4b1-9422-43cd-89c0-246d964c5472 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:56.667854 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f873b4b1-9422-43cd-89c0-246d964c5472 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 17861 microversion: 2.1 time: 0.116160 Dec 15 14:04:56.670817 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 155/315] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:56 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 17861 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:04:56.774868 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6b353cbe-02da-4abe-ba5c-a98f6f3133f7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:56.775481 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6b353cbe-02da-4abe-ba5c-a98f6f3133f7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:56.783164 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b353cbe-02da-4abe-ba5c-a98f6f3133f7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:56.784355 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b353cbe-02da-4abe-ba5c-a98f6f3133f7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:56.785031 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b353cbe-02da-4abe-ba5c-a98f6f3133f7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:56.785492 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b353cbe-02da-4abe-ba5c-a98f6f3133f7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:56.972228 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6b353cbe-02da-4abe-ba5c-a98f6f3133f7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:56.980393 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6b353cbe-02da-4abe-ba5c-a98f6f3133f7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.209954 Dec 15 14:04:56.981050 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 161/316] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:56 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:57.316816 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f1d6a0e5-4609-439f-a2ee-a5de04c7b139 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:57.317856 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f1d6a0e5-4609-439f-a2ee-a5de04c7b139 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:57.324870 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1d6a0e5-4609-439f-a2ee-a5de04c7b139 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:57.325313 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1d6a0e5-4609-439f-a2ee-a5de04c7b139 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:57.326119 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1d6a0e5-4609-439f-a2ee-a5de04c7b139 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:57.326605 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1d6a0e5-4609-439f-a2ee-a5de04c7b139 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:57.433386 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f1d6a0e5-4609-439f-a2ee-a5de04c7b139 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 19133 microversion: 2.20 time: 0.120460 Dec 15 14:04:57.434415 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 156/317] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:04:57 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 19133 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:04:57.680766 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-eb00b147-87d7-4831-97c9-cd3fea240522 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:57.681722 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-eb00b147-87d7-4831-97c9-cd3fea240522 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:57.689002 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb00b147-87d7-4831-97c9-cd3fea240522 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:57.689568 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb00b147-87d7-4831-97c9-cd3fea240522 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:57.690968 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb00b147-87d7-4831-97c9-cd3fea240522 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:57.691498 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb00b147-87d7-4831-97c9-cd3fea240522 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:57.802453 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-eb00b147-87d7-4831-97c9-cd3fea240522 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 18561 microversion: 2.1 time: 0.125634 Dec 15 14:04:57.803732 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 162/318] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:57 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 18561 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:04:57.999091 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d4cf1358-8c6b-4ae8-8560-8863789c918c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:58.000340 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d4cf1358-8c6b-4ae8-8560-8863789c918c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:58.007790 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4cf1358-8c6b-4ae8-8560-8863789c918c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:58.008258 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4cf1358-8c6b-4ae8-8560-8863789c918c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:58.009225 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4cf1358-8c6b-4ae8-8560-8863789c918c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:58.009694 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4cf1358-8c6b-4ae8-8560-8863789c918c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:58.153038 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d4cf1358-8c6b-4ae8-8560-8863789c918c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:58.161753 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d4cf1358-8c6b-4ae8-8560-8863789c918c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.167420 Dec 15 14:04:58.162436 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 157/319] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:57 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:58.446689 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6bcb7ba7-5f68-4ce7-ac22-dfc9c1d5f0a0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:58.447700 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6bcb7ba7-5f68-4ce7-ac22-dfc9c1d5f0a0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:58.454773 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bcb7ba7-5f68-4ce7-ac22-dfc9c1d5f0a0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:58.455222 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bcb7ba7-5f68-4ce7-ac22-dfc9c1d5f0a0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:58.456031 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bcb7ba7-5f68-4ce7-ac22-dfc9c1d5f0a0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:58.456527 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bcb7ba7-5f68-4ce7-ac22-dfc9c1d5f0a0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:58.547810 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6bcb7ba7-5f68-4ce7-ac22-dfc9c1d5f0a0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 20991 microversion: 2.20 time: 0.105219 Dec 15 14:04:58.548505 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 163/320] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:04:58 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 20991 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:04:58.814752 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c22bb287-1c41-4329-83b4-df667b5d73f3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:58.815717 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c22bb287-1c41-4329-83b4-df667b5d73f3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:58.821998 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c22bb287-1c41-4329-83b4-df667b5d73f3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:58.822440 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c22bb287-1c41-4329-83b4-df667b5d73f3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:58.823212 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c22bb287-1c41-4329-83b4-df667b5d73f3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:58.823642 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c22bb287-1c41-4329-83b4-df667b5d73f3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:58.920308 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c22bb287-1c41-4329-83b4-df667b5d73f3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 20997 microversion: 2.1 time: 0.109360 Dec 15 14:04:58.920988 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 158/321] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:58 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 20997 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:04:59.179885 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2e579da7-b3ef-48db-abb5-223236b967ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:59.180669 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2e579da7-b3ef-48db-abb5-223236b967ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:59.188040 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e579da7-b3ef-48db-abb5-223236b967ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:59.188498 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e579da7-b3ef-48db-abb5-223236b967ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:59.189278 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e579da7-b3ef-48db-abb5-223236b967ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:59.189738 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e579da7-b3ef-48db-abb5-223236b967ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:59.343284 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2e579da7-b3ef-48db-abb5-223236b967ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:04:59.352962 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2e579da7-b3ef-48db-abb5-223236b967ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.177467 Dec 15 14:04:59.353623 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 164/322] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:04:59 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:04:59.564428 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-31e96287-d324-42e9-9356-1824436a4951 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:59.565470 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-31e96287-d324-42e9-9356-1824436a4951 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:59.572468 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-31e96287-d324-42e9-9356-1824436a4951 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:59.573132 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-31e96287-d324-42e9-9356-1824436a4951 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:59.573981 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-31e96287-d324-42e9-9356-1824436a4951 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:59.574403 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-31e96287-d324-42e9-9356-1824436a4951 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:59.677096 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-31e96287-d324-42e9-9356-1824436a4951 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 22692 microversion: 2.20 time: 0.120191 Dec 15 14:04:59.681095 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 159/323] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:04:59 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 22692 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:04:59.931616 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-77144e68-1873-4db8-8308-0c435302678d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:04:59.932604 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-77144e68-1873-4db8-8308-0c435302678d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:04:59.938864 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77144e68-1873-4db8-8308-0c435302678d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:59.939310 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77144e68-1873-4db8-8308-0c435302678d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:59.940093 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77144e68-1873-4db8-8308-0c435302678d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:59.940523 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77144e68-1873-4db8-8308-0c435302678d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:00.045367 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-77144e68-1873-4db8-8308-0c435302678d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 22595 microversion: 2.1 time: 0.117224 Dec 15 14:05:00.046152 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 165/324] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:04:59 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 22595 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:00.370878 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-091fd768-ceeb-4ebb-950c-d3e57838d3b2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:00.371552 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-091fd768-ceeb-4ebb-950c-d3e57838d3b2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:00.382046 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-091fd768-ceeb-4ebb-950c-d3e57838d3b2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:00.382558 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-091fd768-ceeb-4ebb-950c-d3e57838d3b2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:00.383934 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-091fd768-ceeb-4ebb-950c-d3e57838d3b2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:00.383934 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-091fd768-ceeb-4ebb-950c-d3e57838d3b2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:00.549264 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-091fd768-ceeb-4ebb-950c-d3e57838d3b2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:00.559748 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-091fd768-ceeb-4ebb-950c-d3e57838d3b2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.192975 Dec 15 14:05:00.560353 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 160/325] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:00 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:00.688905 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-75069e1d-8d8a-4811-815f-2408e7dcbe2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:00.689946 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-75069e1d-8d8a-4811-815f-2408e7dcbe2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:00.698622 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-75069e1d-8d8a-4811-815f-2408e7dcbe2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:00.699082 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-75069e1d-8d8a-4811-815f-2408e7dcbe2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:00.699937 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-75069e1d-8d8a-4811-815f-2408e7dcbe2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:00.700300 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-75069e1d-8d8a-4811-815f-2408e7dcbe2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:00.805454 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-75069e1d-8d8a-4811-815f-2408e7dcbe2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 23804 microversion: 2.20 time: 0.120259 Dec 15 14:05:00.808933 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 166/326] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:00 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 23804 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:01.057934 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-31dbc24f-bff4-4a04-9c3f-8c8bd44641d4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:01.059655 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-31dbc24f-bff4-4a04-9c3f-8c8bd44641d4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:01.066511 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-31dbc24f-bff4-4a04-9c3f-8c8bd44641d4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:01.066965 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-31dbc24f-bff4-4a04-9c3f-8c8bd44641d4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:01.067782 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-31dbc24f-bff4-4a04-9c3f-8c8bd44641d4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:01.068221 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-31dbc24f-bff4-4a04-9c3f-8c8bd44641d4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:01.172610 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-31dbc24f-bff4-4a04-9c3f-8c8bd44641d4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 23803 microversion: 2.1 time: 0.119205 Dec 15 14:05:01.173387 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 161/327] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:01 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 23803 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:01.578749 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6dc69ab4-ced4-46e6-89ec-1280d3eb27a3 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:01.579446 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6dc69ab4-ced4-46e6-89ec-1280d3eb27a3 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:01.586440 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dc69ab4-ced4-46e6-89ec-1280d3eb27a3 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:01.586885 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dc69ab4-ced4-46e6-89ec-1280d3eb27a3 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:01.587662 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dc69ab4-ced4-46e6-89ec-1280d3eb27a3 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:01.588099 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dc69ab4-ced4-46e6-89ec-1280d3eb27a3 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:01.759068 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6dc69ab4-ced4-46e6-89ec-1280d3eb27a3 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:01.766531 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6dc69ab4-ced4-46e6-89ec-1280d3eb27a3 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.192398 Dec 15 14:05:01.767414 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 167/328] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:01 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:01.821682 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a392cb3c-b706-4234-9613-3865f6dcfd0a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:01.822883 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a392cb3c-b706-4234-9613-3865f6dcfd0a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:01.830531 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a392cb3c-b706-4234-9613-3865f6dcfd0a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:01.830975 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a392cb3c-b706-4234-9613-3865f6dcfd0a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:01.831751 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a392cb3c-b706-4234-9613-3865f6dcfd0a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:01.832176 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a392cb3c-b706-4234-9613-3865f6dcfd0a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:01.927215 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a392cb3c-b706-4234-9613-3865f6dcfd0a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 24664 microversion: 2.20 time: 0.110085 Dec 15 14:05:01.928647 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 162/329] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:01 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 24664 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:05:02.184395 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2f98d831-38ee-44fd-9785-62061ae64ad5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:02.185475 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2f98d831-38ee-44fd-9785-62061ae64ad5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:02.192105 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f98d831-38ee-44fd-9785-62061ae64ad5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:02.192560 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f98d831-38ee-44fd-9785-62061ae64ad5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:02.193649 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f98d831-38ee-44fd-9785-62061ae64ad5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:02.194109 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f98d831-38ee-44fd-9785-62061ae64ad5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:02.304121 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2f98d831-38ee-44fd-9785-62061ae64ad5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 24546 microversion: 2.1 time: 0.123142 Dec 15 14:05:02.304705 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 168/330] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:02 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 24546 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:02.786036 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0d91ad26-6ed1-41eb-8fba-68ef0a0fb10f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:02.788024 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0d91ad26-6ed1-41eb-8fba-68ef0a0fb10f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:02.799079 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d91ad26-6ed1-41eb-8fba-68ef0a0fb10f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:02.799987 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d91ad26-6ed1-41eb-8fba-68ef0a0fb10f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:02.801030 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d91ad26-6ed1-41eb-8fba-68ef0a0fb10f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:02.801648 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d91ad26-6ed1-41eb-8fba-68ef0a0fb10f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:02.948919 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0d91ad26-6ed1-41eb-8fba-68ef0a0fb10f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:02.956464 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0d91ad26-6ed1-41eb-8fba-68ef0a0fb10f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.175916 Dec 15 14:05:02.957174 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 163/331] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:02 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:02.981016 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4d327c90-1552-4ad3-a15a-42afc86c7c77 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:02.982048 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4d327c90-1552-4ad3-a15a-42afc86c7c77 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:02.989660 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d327c90-1552-4ad3-a15a-42afc86c7c77 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:02.990236 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d327c90-1552-4ad3-a15a-42afc86c7c77 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:02.991353 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d327c90-1552-4ad3-a15a-42afc86c7c77 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:02.991896 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d327c90-1552-4ad3-a15a-42afc86c7c77 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:03.233223 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4d327c90-1552-4ad3-a15a-42afc86c7c77 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 25604 microversion: 2.20 time: 0.255716 Dec 15 14:05:03.233922 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 169/332] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:02 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 25604 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:03.318116 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c6f0fbb0-4a84-4987-8637-5b8fa4c9853f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:03.319079 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c6f0fbb0-4a84-4987-8637-5b8fa4c9853f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:03.330762 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c6f0fbb0-4a84-4987-8637-5b8fa4c9853f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:03.331645 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c6f0fbb0-4a84-4987-8637-5b8fa4c9853f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:03.332629 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c6f0fbb0-4a84-4987-8637-5b8fa4c9853f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:03.333220 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c6f0fbb0-4a84-4987-8637-5b8fa4c9853f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:03.445711 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c6f0fbb0-4a84-4987-8637-5b8fa4c9853f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 25405 microversion: 2.1 time: 0.130739 Dec 15 14:05:03.446461 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 164/333] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:03 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 25405 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:03.975381 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d9ec08ed-f224-4b77-97f9-089438f78e09 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:03.976213 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d9ec08ed-f224-4b77-97f9-089438f78e09 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:03.984284 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9ec08ed-f224-4b77-97f9-089438f78e09 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:03.984884 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9ec08ed-f224-4b77-97f9-089438f78e09 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:03.985499 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9ec08ed-f224-4b77-97f9-089438f78e09 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:03.985964 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9ec08ed-f224-4b77-97f9-089438f78e09 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:04.129072 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d9ec08ed-f224-4b77-97f9-089438f78e09 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:04.137428 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d9ec08ed-f224-4b77-97f9-089438f78e09 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.166569 Dec 15 14:05:04.138036 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 170/334] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:03 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:04.253838 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d24429da-f133-43b5-ad8f-b79872663cb0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:04.255526 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d24429da-f133-43b5-ad8f-b79872663cb0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:04.264356 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d24429da-f133-43b5-ad8f-b79872663cb0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:04.264737 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d24429da-f133-43b5-ad8f-b79872663cb0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:04.265574 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d24429da-f133-43b5-ad8f-b79872663cb0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:04.266033 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d24429da-f133-43b5-ad8f-b79872663cb0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:04.367141 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d24429da-f133-43b5-ad8f-b79872663cb0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 26441 microversion: 2.20 time: 0.120889 Dec 15 14:05:04.368549 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 165/335] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:04 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 26441 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:04.457980 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-29584017-cf03-4ec3-999d-89aac22dd2f0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:04.459171 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-29584017-cf03-4ec3-999d-89aac22dd2f0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:04.466384 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29584017-cf03-4ec3-999d-89aac22dd2f0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:04.466970 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29584017-cf03-4ec3-999d-89aac22dd2f0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:04.467859 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29584017-cf03-4ec3-999d-89aac22dd2f0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:04.468286 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29584017-cf03-4ec3-999d-89aac22dd2f0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:04.592736 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-29584017-cf03-4ec3-999d-89aac22dd2f0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 26264 microversion: 2.1 time: 0.138404 Dec 15 14:05:04.593392 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 171/336] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:04 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 26264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:05:05.155469 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-68ad479d-a8b4-46d4-a5ca-d920dffd146b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:05.156158 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-68ad479d-a8b4-46d4-a5ca-d920dffd146b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:05.164038 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68ad479d-a8b4-46d4-a5ca-d920dffd146b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:05.164520 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68ad479d-a8b4-46d4-a5ca-d920dffd146b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:05.165338 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68ad479d-a8b4-46d4-a5ca-d920dffd146b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:05.165813 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68ad479d-a8b4-46d4-a5ca-d920dffd146b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:05.310511 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-68ad479d-a8b4-46d4-a5ca-d920dffd146b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:05.318542 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-68ad479d-a8b4-46d4-a5ca-d920dffd146b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.167137 Dec 15 14:05:05.319156 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 166/337] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:05 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:05.380957 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2873f3d1-e5bd-4ba0-81c6-88ebe53f2fb2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:05.381993 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2873f3d1-e5bd-4ba0-81c6-88ebe53f2fb2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:05.389770 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2873f3d1-e5bd-4ba0-81c6-88ebe53f2fb2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:05.390227 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2873f3d1-e5bd-4ba0-81c6-88ebe53f2fb2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:05.391028 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2873f3d1-e5bd-4ba0-81c6-88ebe53f2fb2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:05.391463 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2873f3d1-e5bd-4ba0-81c6-88ebe53f2fb2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:05.486600 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2873f3d1-e5bd-4ba0-81c6-88ebe53f2fb2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 27129 microversion: 2.20 time: 0.110117 Dec 15 14:05:05.487371 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 172/338] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:05 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 27129 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:05.611609 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d076802d-4bc1-443e-bdfd-9259be8de58c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:05.612807 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d076802d-4bc1-443e-bdfd-9259be8de58c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:05.622108 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d076802d-4bc1-443e-bdfd-9259be8de58c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:05.622555 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d076802d-4bc1-443e-bdfd-9259be8de58c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:05.623256 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d076802d-4bc1-443e-bdfd-9259be8de58c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:05.623697 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d076802d-4bc1-443e-bdfd-9259be8de58c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:05.727990 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d076802d-4bc1-443e-bdfd-9259be8de58c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 26916 microversion: 2.1 time: 0.125910 Dec 15 14:05:05.728984 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 167/339] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:05 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 26916 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:06.336455 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9f4feb11-2353-4bbb-ace0-a68b65dfdee4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:06.337141 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9f4feb11-2353-4bbb-ace0-a68b65dfdee4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:06.344703 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f4feb11-2353-4bbb-ace0-a68b65dfdee4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:06.345151 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f4feb11-2353-4bbb-ace0-a68b65dfdee4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:06.345978 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f4feb11-2353-4bbb-ace0-a68b65dfdee4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:06.346409 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f4feb11-2353-4bbb-ace0-a68b65dfdee4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:06.494487 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9f4feb11-2353-4bbb-ace0-a68b65dfdee4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:06.499559 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3ded9966-4817-4089-b070-7fa41cccd52c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:06.500567 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3ded9966-4817-4089-b070-7fa41cccd52c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:06.503558 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9f4feb11-2353-4bbb-ace0-a68b65dfdee4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.171061 Dec 15 14:05:06.504418 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 173/340] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:06 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:06.509110 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3ded9966-4817-4089-b070-7fa41cccd52c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:06.509824 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3ded9966-4817-4089-b070-7fa41cccd52c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:06.510865 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3ded9966-4817-4089-b070-7fa41cccd52c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:06.511684 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3ded9966-4817-4089-b070-7fa41cccd52c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:06.782181 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-67128672-22f3-4e81-a611-966263720476 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:06.783138 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-67128672-22f3-4e81-a611-966263720476 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:06.790005 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67128672-22f3-4e81-a611-966263720476 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:06.790450 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67128672-22f3-4e81-a611-966263720476 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:06.791233 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67128672-22f3-4e81-a611-966263720476 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:06.791662 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67128672-22f3-4e81-a611-966263720476 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:18.298616 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3ded9966-4817-4089-b070-7fa41cccd52c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 27812 microversion: 2.20 time: 11.802899 Dec 15 14:05:18.302700 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 168/341] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:06 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 27812 bytes in 11806 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:05:18.305042 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9a4426a9-790f-414f-9870-8d241c7b4744 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:18.305746 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9a4426a9-790f-414f-9870-8d241c7b4744 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:18.312587 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a4426a9-790f-414f-9870-8d241c7b4744 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:18.313044 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a4426a9-790f-414f-9870-8d241c7b4744 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:18.313887 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a4426a9-790f-414f-9870-8d241c7b4744 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:18.314118 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-67128672-22f3-4e81-a611-966263720476 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 27783 microversion: 2.1 time: 11.535470 Dec 15 14:05:18.314626 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a4426a9-790f-414f-9870-8d241c7b4744 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:18.315523 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 174/342] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:06 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 27783 bytes in 11537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:18.466392 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9a4426a9-790f-414f-9870-8d241c7b4744 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:18.474568 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9a4426a9-790f-414f-9870-8d241c7b4744 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.173168 Dec 15 14:05:18.475139 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 169/343] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:18 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:19.327099 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c093ca0e-2774-4e1a-9c76-3ead964e1bf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:19.328026 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c093ca0e-2774-4e1a-9c76-3ead964e1bf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:19.332750 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a2c5872e-15de-4e62-93da-008a4dc3565f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:19.333765 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a2c5872e-15de-4e62-93da-008a4dc3565f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:19.338952 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c093ca0e-2774-4e1a-9c76-3ead964e1bf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:19.339403 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c093ca0e-2774-4e1a-9c76-3ead964e1bf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:19.340224 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c093ca0e-2774-4e1a-9c76-3ead964e1bf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:19.340788 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c093ca0e-2774-4e1a-9c76-3ead964e1bf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:19.350882 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2c5872e-15de-4e62-93da-008a4dc3565f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:19.351243 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2c5872e-15de-4e62-93da-008a4dc3565f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:19.352040 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2c5872e-15de-4e62-93da-008a4dc3565f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:19.352467 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2c5872e-15de-4e62-93da-008a4dc3565f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:19.454551 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c093ca0e-2774-4e1a-9c76-3ead964e1bf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 27783 microversion: 2.1 time: 0.130788 Dec 15 14:05:19.455488 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 170/344] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:19 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 27783 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:05:19.494672 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c5ade3f1-a289-477f-b1d3-a58bcf920666 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:19.495574 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c5ade3f1-a289-477f-b1d3-a58bcf920666 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:19.504619 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c5ade3f1-a289-477f-b1d3-a58bcf920666 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:19.505061 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c5ade3f1-a289-477f-b1d3-a58bcf920666 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:19.505859 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c5ade3f1-a289-477f-b1d3-a58bcf920666 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:19.506292 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c5ade3f1-a289-477f-b1d3-a58bcf920666 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:19.648785 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c5ade3f1-a289-477f-b1d3-a58bcf920666 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:19.656519 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c5ade3f1-a289-477f-b1d3-a58bcf920666 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.167990 Dec 15 14:05:19.657086 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 171/345] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:19 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:20.466731 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4c16b683-c505-4f24-a0d7-32b8cefba1aa tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:20.467677 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4c16b683-c505-4f24-a0d7-32b8cefba1aa tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:20.474439 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4c16b683-c505-4f24-a0d7-32b8cefba1aa tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:20.474897 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4c16b683-c505-4f24-a0d7-32b8cefba1aa tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:20.475711 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4c16b683-c505-4f24-a0d7-32b8cefba1aa tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:20.476145 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4c16b683-c505-4f24-a0d7-32b8cefba1aa tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:24.318678 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a2c5872e-15de-4e62-93da-008a4dc3565f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 27812 microversion: 2.20 time: 5.000394 Dec 15 14:05:24.320254 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 175/346] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:19 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 27812 bytes in 5012 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:24.325843 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-21503075-ec8b-4933-9ca8-7848ade1ed84 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:24.326564 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-21503075-ec8b-4933-9ca8-7848ade1ed84 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:24.336026 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21503075-ec8b-4933-9ca8-7848ade1ed84 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:24.336903 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21503075-ec8b-4933-9ca8-7848ade1ed84 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:24.337653 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21503075-ec8b-4933-9ca8-7848ade1ed84 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:24.338112 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21503075-ec8b-4933-9ca8-7848ade1ed84 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:24.477388 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-21503075-ec8b-4933-9ca8-7848ade1ed84 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:24.489135 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-21503075-ec8b-4933-9ca8-7848ade1ed84 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.167468 Dec 15 14:05:24.490052 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 176/347] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:24 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:25.335382 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e3b99b23-f973-4421-b859-4f8fab347d7d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:25.336307 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e3b99b23-f973-4421-b859-4f8fab347d7d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:25.342998 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e3b99b23-f973-4421-b859-4f8fab347d7d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:25.343461 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e3b99b23-f973-4421-b859-4f8fab347d7d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:25.344263 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e3b99b23-f973-4421-b859-4f8fab347d7d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:25.344701 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e3b99b23-f973-4421-b859-4f8fab347d7d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:25.936533 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4c16b683-c505-4f24-a0d7-32b8cefba1aa tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 27783 microversion: 2.1 time: 5.472945 Dec 15 14:05:25.937518 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 172/348] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:20 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 27783 bytes in 5475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:05:25.947062 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5e42618d-8986-4c6a-8076-ad9a09678610 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:25.948159 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5e42618d-8986-4c6a-8076-ad9a09678610 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:25.961966 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e42618d-8986-4c6a-8076-ad9a09678610 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:25.962418 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e42618d-8986-4c6a-8076-ad9a09678610 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:25.963196 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e42618d-8986-4c6a-8076-ad9a09678610 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:25.963624 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e42618d-8986-4c6a-8076-ad9a09678610 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:25.975993 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e3b99b23-f973-4421-b859-4f8fab347d7d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 27878 microversion: 2.20 time: 0.647000 Dec 15 14:05:25.976871 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 177/349] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:25 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 27878 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:26.109911 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5e42618d-8986-4c6a-8076-ad9a09678610 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:26.119911 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5e42618d-8986-4c6a-8076-ad9a09678610 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.180585 Dec 15 14:05:26.120491 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 173/350] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:25 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:26.952335 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e5bb9722-ee99-416e-95a1-eacceb21ef57 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:26.953360 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e5bb9722-ee99-416e-95a1-eacceb21ef57 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:26.961333 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5bb9722-ee99-416e-95a1-eacceb21ef57 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:26.962011 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5bb9722-ee99-416e-95a1-eacceb21ef57 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:26.962828 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5bb9722-ee99-416e-95a1-eacceb21ef57 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:26.963259 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5bb9722-ee99-416e-95a1-eacceb21ef57 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:26.988910 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-04adfca3-4518-42f2-9a3e-863f6de071ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:26.989827 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-04adfca3-4518-42f2-9a3e-863f6de071ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:26.997250 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-04adfca3-4518-42f2-9a3e-863f6de071ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:26.997753 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-04adfca3-4518-42f2-9a3e-863f6de071ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:26.998533 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-04adfca3-4518-42f2-9a3e-863f6de071ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:26.998963 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-04adfca3-4518-42f2-9a3e-863f6de071ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:27.113956 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e5bb9722-ee99-416e-95a1-eacceb21ef57 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 27910 microversion: 2.1 time: 0.166065 Dec 15 14:05:27.114992 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 178/351] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:26 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 27910 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:27.138197 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-01f398d8-aa26-46f2-872d-ff334af94b7f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:27.138884 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-01f398d8-aa26-46f2-872d-ff334af94b7f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:27.146268 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01f398d8-aa26-46f2-872d-ff334af94b7f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:27.146710 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01f398d8-aa26-46f2-872d-ff334af94b7f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:27.147076 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-04adfca3-4518-42f2-9a3e-863f6de071ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 27878 microversion: 2.20 time: 0.161626 Dec 15 14:05:27.147486 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01f398d8-aa26-46f2-872d-ff334af94b7f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:27.147755 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 174/352] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:26 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 27878 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:27.147899 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01f398d8-aa26-46f2-872d-ff334af94b7f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:27.304505 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-01f398d8-aa26-46f2-872d-ff334af94b7f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:27.312777 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-01f398d8-aa26-46f2-872d-ff334af94b7f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.178870 Dec 15 14:05:27.313347 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 179/353] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:27 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:28.133191 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3aa612cb-4f05-4924-9f71-d2649e29fa44 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:28.135382 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3aa612cb-4f05-4924-9f71-d2649e29fa44 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:28.146976 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3aa612cb-4f05-4924-9f71-d2649e29fa44 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:28.147499 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3aa612cb-4f05-4924-9f71-d2649e29fa44 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:28.148462 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3aa612cb-4f05-4924-9f71-d2649e29fa44 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:28.148988 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3aa612cb-4f05-4924-9f71-d2649e29fa44 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:28.159811 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-747b25b9-afda-4d10-84d6-f7e2a6d98e29 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:28.160725 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-747b25b9-afda-4d10-84d6-f7e2a6d98e29 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:28.167874 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-747b25b9-afda-4d10-84d6-f7e2a6d98e29 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:28.168313 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-747b25b9-afda-4d10-84d6-f7e2a6d98e29 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:28.169102 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-747b25b9-afda-4d10-84d6-f7e2a6d98e29 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:28.169524 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-747b25b9-afda-4d10-84d6-f7e2a6d98e29 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:28.293771 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3aa612cb-4f05-4924-9f71-d2649e29fa44 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 27961 microversion: 2.1 time: 0.167989 Dec 15 14:05:28.294364 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 175/354] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:28 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 27961 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:28.324710 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-747b25b9-afda-4d10-84d6-f7e2a6d98e29 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28057 microversion: 2.20 time: 0.168338 Dec 15 14:05:28.325342 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 180/355] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:28 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28057 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:28.330393 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9a2c3fbb-95ae-4029-8589-0fd72500a6b7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:28.331110 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9a2c3fbb-95ae-4029-8589-0fd72500a6b7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:28.338798 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a2c3fbb-95ae-4029-8589-0fd72500a6b7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:28.339247 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a2c3fbb-95ae-4029-8589-0fd72500a6b7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:28.340048 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a2c3fbb-95ae-4029-8589-0fd72500a6b7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:28.340484 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a2c3fbb-95ae-4029-8589-0fd72500a6b7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:28.762569 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9a2c3fbb-95ae-4029-8589-0fd72500a6b7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:28.770710 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9a2c3fbb-95ae-4029-8589-0fd72500a6b7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.444357 Dec 15 14:05:28.771267 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 176/356] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:28 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:05:29.307223 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-66c4c741-8a39-42d0-8dc9-389cc8e163e0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:29.308194 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-66c4c741-8a39-42d0-8dc9-389cc8e163e0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:29.315937 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66c4c741-8a39-42d0-8dc9-389cc8e163e0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:29.316384 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66c4c741-8a39-42d0-8dc9-389cc8e163e0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:29.317160 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66c4c741-8a39-42d0-8dc9-389cc8e163e0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:29.317591 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66c4c741-8a39-42d0-8dc9-389cc8e163e0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:29.337026 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cc2a72a0-7841-4919-a631-34ff25df891d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:29.338261 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cc2a72a0-7841-4919-a631-34ff25df891d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:29.345392 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cc2a72a0-7841-4919-a631-34ff25df891d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:29.345875 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cc2a72a0-7841-4919-a631-34ff25df891d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:29.346653 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cc2a72a0-7841-4919-a631-34ff25df891d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:29.347079 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cc2a72a0-7841-4919-a631-34ff25df891d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:29.956308 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cc2a72a0-7841-4919-a631-34ff25df891d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 0.623291 Dec 15 14:05:29.956982 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 177/357] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:29 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:29.961916 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b2dcced1-5dfb-4d19-89c2-d376e5857e7b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:29.962744 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b2dcced1-5dfb-4d19-89c2-d376e5857e7b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:29.969993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b2dcced1-5dfb-4d19-89c2-d376e5857e7b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:29.970423 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b2dcced1-5dfb-4d19-89c2-d376e5857e7b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:29.971214 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b2dcced1-5dfb-4d19-89c2-d376e5857e7b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:29.971641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b2dcced1-5dfb-4d19-89c2-d376e5857e7b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:29.976171 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-66c4c741-8a39-42d0-8dc9-389cc8e163e0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28104 microversion: 2.1 time: 0.673521 Dec 15 14:05:29.976924 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 181/358] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:29 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28104 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:30.119662 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b2dcced1-5dfb-4d19-89c2-d376e5857e7b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:30.129759 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b2dcced1-5dfb-4d19-89c2-d376e5857e7b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1520 microversion: 2.1 time: 0.171361 Dec 15 14:05:30.130611 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 178/359] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:29 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:30.970548 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-83dc232d-0cbd-46c9-878b-60beae2b4169 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:30.971793 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-83dc232d-0cbd-46c9-878b-60beae2b4169 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:30.982961 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83dc232d-0cbd-46c9-878b-60beae2b4169 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:30.983464 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83dc232d-0cbd-46c9-878b-60beae2b4169 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:30.984210 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83dc232d-0cbd-46c9-878b-60beae2b4169 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:30.984669 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83dc232d-0cbd-46c9-878b-60beae2b4169 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:30.989015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0ed607ab-c88b-44fd-9704-5e6273f416cd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:30.989966 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0ed607ab-c88b-44fd-9704-5e6273f416cd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:30.997055 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ed607ab-c88b-44fd-9704-5e6273f416cd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:30.997545 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ed607ab-c88b-44fd-9704-5e6273f416cd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:30.998317 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ed607ab-c88b-44fd-9704-5e6273f416cd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:30.998750 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ed607ab-c88b-44fd-9704-5e6273f416cd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:31.205939 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0ed607ab-c88b-44fd-9704-5e6273f416cd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.220386 Dec 15 14:05:31.206513 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 179/360] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:30 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:31.215423 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0ae1ede1-a6f9-4ab5-8182-8ec5ebdb0237 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:31.216121 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0ae1ede1-a6f9-4ab5-8182-8ec5ebdb0237 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:31.223097 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-83dc232d-0cbd-46c9-878b-60beae2b4169 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 0.257396 Dec 15 14:05:31.227176 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 182/361] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:30 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:31.227313 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ae1ede1-a6f9-4ab5-8182-8ec5ebdb0237 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:31.227313 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ae1ede1-a6f9-4ab5-8182-8ec5ebdb0237 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:31.227313 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ae1ede1-a6f9-4ab5-8182-8ec5ebdb0237 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:31.227313 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ae1ede1-a6f9-4ab5-8182-8ec5ebdb0237 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:31.370693 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0ae1ede1-a6f9-4ab5-8182-8ec5ebdb0237 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:31.379167 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0ae1ede1-a6f9-4ab5-8182-8ec5ebdb0237 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1500 microversion: 2.1 time: 0.171467 Dec 15 14:05:31.379747 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 180/362] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:31 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1500 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:31.396033 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-65ea0cb0-c5a4-4467-acdb-0737c9f8d16d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:31.396725 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-65ea0cb0-c5a4-4467-acdb-0737c9f8d16d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:31.404209 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-65ea0cb0-c5a4-4467-acdb-0737c9f8d16d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:31.404649 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-65ea0cb0-c5a4-4467-acdb-0737c9f8d16d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:31.405433 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-65ea0cb0-c5a4-4467-acdb-0737c9f8d16d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:31.405875 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-65ea0cb0-c5a4-4467-acdb-0737c9f8d16d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:31.550973 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-65ea0cb0-c5a4-4467-acdb-0737c9f8d16d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:31.560119 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-65ea0cb0-c5a4-4467-acdb-0737c9f8d16d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1515 microversion: 2.1 time: 0.168106 Dec 15 14:05:31.560669 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 183/363] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:31 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:32.222327 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e121a0c4-955d-4a7e-afdb-3b4fe30a64ae tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:32.223787 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e121a0c4-955d-4a7e-afdb-3b4fe30a64ae tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:32.232752 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e121a0c4-955d-4a7e-afdb-3b4fe30a64ae tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:32.233206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e121a0c4-955d-4a7e-afdb-3b4fe30a64ae tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:32.234054 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e121a0c4-955d-4a7e-afdb-3b4fe30a64ae tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:32.234493 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e121a0c4-955d-4a7e-afdb-3b4fe30a64ae tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:32.235557 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8bc2d527-4d95-4e37-9364-e3f8e0ddf67a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:32.236557 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8bc2d527-4d95-4e37-9364-e3f8e0ddf67a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:32.243341 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8bc2d527-4d95-4e37-9364-e3f8e0ddf67a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:32.243938 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8bc2d527-4d95-4e37-9364-e3f8e0ddf67a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:32.244767 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8bc2d527-4d95-4e37-9364-e3f8e0ddf67a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:32.245266 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8bc2d527-4d95-4e37-9364-e3f8e0ddf67a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:32.359031 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e121a0c4-955d-4a7e-afdb-3b4fe30a64ae tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.142756 Dec 15 14:05:32.359693 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 181/364] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:32 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:32.382877 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8bc2d527-4d95-4e37-9364-e3f8e0ddf67a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 0.151177 Dec 15 14:05:32.383535 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 184/365] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:32 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:33.371865 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1f251c45-e809-4c21-8fc1-d3e799ab9578 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:33.372893 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1f251c45-e809-4c21-8fc1-d3e799ab9578 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:33.380647 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1f251c45-e809-4c21-8fc1-d3e799ab9578 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:33.381097 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1f251c45-e809-4c21-8fc1-d3e799ab9578 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:33.381914 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1f251c45-e809-4c21-8fc1-d3e799ab9578 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:33.382343 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1f251c45-e809-4c21-8fc1-d3e799ab9578 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:33.395912 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9c89e7d1-b940-4975-bf8b-024527da6fe1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:33.397149 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9c89e7d1-b940-4975-bf8b-024527da6fe1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:33.404531 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c89e7d1-b940-4975-bf8b-024527da6fe1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:33.405038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c89e7d1-b940-4975-bf8b-024527da6fe1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:33.405907 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c89e7d1-b940-4975-bf8b-024527da6fe1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:33.406333 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c89e7d1-b940-4975-bf8b-024527da6fe1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:33.487315 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1f251c45-e809-4c21-8fc1-d3e799ab9578 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.119285 Dec 15 14:05:33.488130 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 182/366] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:33 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:33.517232 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9c89e7d1-b940-4975-bf8b-024527da6fe1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 0.124575 Dec 15 14:05:33.518123 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 185/367] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:33 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:33.984890 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-443ea971-21a3-4a83-bd4e-36180fa07c65 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:33.986082 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-443ea971-21a3-4a83-bd4e-36180fa07c65 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:33.993960 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-443ea971-21a3-4a83-bd4e-36180fa07c65 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:33.994401 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-443ea971-21a3-4a83-bd4e-36180fa07c65 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:33.995188 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-443ea971-21a3-4a83-bd4e-36180fa07c65 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:33.995627 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-443ea971-21a3-4a83-bd4e-36180fa07c65 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:34.021117 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-443ea971-21a3-4a83-bd4e-36180fa07c65 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lazy-loading 'flavor' on Instance uuid bfccdaf0-2b79-4ace-a816-8c76eba7f48b {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:05:34.102319 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-443ea971-21a3-4a83-bd4e-36180fa07c65 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "POST /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b/action" status: 200 len: 32 microversion: 2.1 time: 0.124423 Dec 15 14:05:34.107554 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 183/368] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:33 2021] POST /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b/action => generated 32 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:05:34.114378 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-77b2af6c-264a-4228-b85d-8bc3208ae11f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:34.115305 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-77b2af6c-264a-4228-b85d-8bc3208ae11f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:34.122227 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77b2af6c-264a-4228-b85d-8bc3208ae11f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:34.122667 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77b2af6c-264a-4228-b85d-8bc3208ae11f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:34.123436 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77b2af6c-264a-4228-b85d-8bc3208ae11f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:34.123893 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77b2af6c-264a-4228-b85d-8bc3208ae11f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:34.350536 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-77b2af6c-264a-4228-b85d-8bc3208ae11f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:34.358496 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-77b2af6c-264a-4228-b85d-8bc3208ae11f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.248790 Dec 15 14:05:34.358837 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 186/369] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:34 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:34.502256 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c622be63-97f8-4680-bad5-8d60f2c5d0ce tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:34.503371 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c622be63-97f8-4680-bad5-8d60f2c5d0ce tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:34.510001 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c622be63-97f8-4680-bad5-8d60f2c5d0ce tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:34.510538 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c622be63-97f8-4680-bad5-8d60f2c5d0ce tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:34.511429 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c622be63-97f8-4680-bad5-8d60f2c5d0ce tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:34.511928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c622be63-97f8-4680-bad5-8d60f2c5d0ce tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:34.531353 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ee78cd91-7f40-4864-8404-d220d997a539 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:34.532667 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ee78cd91-7f40-4864-8404-d220d997a539 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:34.540028 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee78cd91-7f40-4864-8404-d220d997a539 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:34.540749 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee78cd91-7f40-4864-8404-d220d997a539 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:34.542789 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee78cd91-7f40-4864-8404-d220d997a539 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:34.543164 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee78cd91-7f40-4864-8404-d220d997a539 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:34.622485 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c622be63-97f8-4680-bad5-8d60f2c5d0ce tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.125882 Dec 15 14:05:34.626918 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 184/370] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:34 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:34.657107 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ee78cd91-7f40-4864-8404-d220d997a539 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 0.129768 Dec 15 14:05:34.658123 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 187/371] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:34 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:35.378928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0ca27133-a0f8-409c-9e26-fdb17b5a59f4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:35.379686 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0ca27133-a0f8-409c-9e26-fdb17b5a59f4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:35.386927 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ca27133-a0f8-409c-9e26-fdb17b5a59f4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:35.387375 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ca27133-a0f8-409c-9e26-fdb17b5a59f4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:35.388164 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ca27133-a0f8-409c-9e26-fdb17b5a59f4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:35.388600 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ca27133-a0f8-409c-9e26-fdb17b5a59f4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:35.532641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0ca27133-a0f8-409c-9e26-fdb17b5a59f4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:35.541557 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0ca27133-a0f8-409c-9e26-fdb17b5a59f4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.166796 Dec 15 14:05:35.542167 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 185/372] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:35 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:35.637986 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7211757f-5731-41dc-af62-a080c43da40c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:35.639201 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7211757f-5731-41dc-af62-a080c43da40c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:35.649933 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7211757f-5731-41dc-af62-a080c43da40c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:35.650408 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7211757f-5731-41dc-af62-a080c43da40c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:35.651194 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7211757f-5731-41dc-af62-a080c43da40c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:35.651628 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7211757f-5731-41dc-af62-a080c43da40c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:35.671614 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-34b17da1-7395-48df-a7e5-c020e286a3ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:35.672730 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-34b17da1-7395-48df-a7e5-c020e286a3ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:35.679628 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34b17da1-7395-48df-a7e5-c020e286a3ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:35.680081 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34b17da1-7395-48df-a7e5-c020e286a3ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:35.680882 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34b17da1-7395-48df-a7e5-c020e286a3ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:35.681319 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34b17da1-7395-48df-a7e5-c020e286a3ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:35.833903 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7211757f-5731-41dc-af62-a080c43da40c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.201094 Dec 15 14:05:35.834792 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 188/373] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:35 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:35.861248 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-34b17da1-7395-48df-a7e5-c020e286a3ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 0.195722 Dec 15 14:05:35.861984 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 186/374] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:35 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:36.559173 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d66f885b-ed27-45a9-8ecc-1190b5eb993f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:36.559905 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d66f885b-ed27-45a9-8ecc-1190b5eb993f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:36.567443 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d66f885b-ed27-45a9-8ecc-1190b5eb993f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:36.567901 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d66f885b-ed27-45a9-8ecc-1190b5eb993f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:36.568684 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d66f885b-ed27-45a9-8ecc-1190b5eb993f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:36.569099 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d66f885b-ed27-45a9-8ecc-1190b5eb993f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:36.734543 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d66f885b-ed27-45a9-8ecc-1190b5eb993f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:36.742396 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d66f885b-ed27-45a9-8ecc-1190b5eb993f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.187225 Dec 15 14:05:36.742949 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 189/375] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:36 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:36.847428 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3b1e0b2d-0405-4c1c-86d1-f27a4a4bdaa6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:36.848437 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3b1e0b2d-0405-4c1c-86d1-f27a4a4bdaa6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:36.855375 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b1e0b2d-0405-4c1c-86d1-f27a4a4bdaa6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:36.855826 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b1e0b2d-0405-4c1c-86d1-f27a4a4bdaa6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:36.856995 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b1e0b2d-0405-4c1c-86d1-f27a4a4bdaa6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:36.857507 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b1e0b2d-0405-4c1c-86d1-f27a4a4bdaa6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:36.872746 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bd0f24e5-4caf-40f1-89cc-1e1837ba8757 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:36.873711 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bd0f24e5-4caf-40f1-89cc-1e1837ba8757 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:36.884755 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bd0f24e5-4caf-40f1-89cc-1e1837ba8757 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:36.885205 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bd0f24e5-4caf-40f1-89cc-1e1837ba8757 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:36.886042 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bd0f24e5-4caf-40f1-89cc-1e1837ba8757 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:36.886477 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bd0f24e5-4caf-40f1-89cc-1e1837ba8757 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:36.964173 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3b1e0b2d-0405-4c1c-86d1-f27a4a4bdaa6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.121109 Dec 15 14:05:36.964906 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 187/376] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:36 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:36.990123 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bd0f24e5-4caf-40f1-89cc-1e1837ba8757 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 0.121102 Dec 15 14:05:36.990770 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 190/377] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:36 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:37.763685 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8b7207ec-39eb-497f-9e7d-f1d564508b87 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:37.764260 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8b7207ec-39eb-497f-9e7d-f1d564508b87 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:37.773062 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b7207ec-39eb-497f-9e7d-f1d564508b87 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:37.773559 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b7207ec-39eb-497f-9e7d-f1d564508b87 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:37.774375 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b7207ec-39eb-497f-9e7d-f1d564508b87 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:37.774803 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b7207ec-39eb-497f-9e7d-f1d564508b87 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:37.937916 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8b7207ec-39eb-497f-9e7d-f1d564508b87 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:37.950303 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8b7207ec-39eb-497f-9e7d-f1d564508b87 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.193295 Dec 15 14:05:37.951168 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 188/378] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:37 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:37.978128 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-516169f4-f443-4ee1-83ef-145e74bf25e7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:37.979151 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-516169f4-f443-4ee1-83ef-145e74bf25e7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:37.987272 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-516169f4-f443-4ee1-83ef-145e74bf25e7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:37.987943 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-516169f4-f443-4ee1-83ef-145e74bf25e7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:37.988684 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-516169f4-f443-4ee1-83ef-145e74bf25e7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:37.989123 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-516169f4-f443-4ee1-83ef-145e74bf25e7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:38.002719 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1f513445-9fc8-4b60-9ddc-f65e4b476922 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:38.003704 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1f513445-9fc8-4b60-9ddc-f65e4b476922 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:38.010098 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1f513445-9fc8-4b60-9ddc-f65e4b476922 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:38.010582 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1f513445-9fc8-4b60-9ddc-f65e4b476922 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:38.011537 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1f513445-9fc8-4b60-9ddc-f65e4b476922 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:38.011968 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1f513445-9fc8-4b60-9ddc-f65e4b476922 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:38.103461 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-516169f4-f443-4ee1-83ef-145e74bf25e7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.129393 Dec 15 14:05:38.104313 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 191/379] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:37 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:38.231393 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1f513445-9fc8-4b60-9ddc-f65e4b476922 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 0.232681 Dec 15 14:05:38.232482 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 189/380] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:37 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:38.973014 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d0607ddb-d195-48dd-a671-06aba5e4c5a1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:38.973742 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d0607ddb-d195-48dd-a671-06aba5e4c5a1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:38.980890 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0607ddb-d195-48dd-a671-06aba5e4c5a1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:38.981863 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0607ddb-d195-48dd-a671-06aba5e4c5a1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:38.982455 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0607ddb-d195-48dd-a671-06aba5e4c5a1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:38.982888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0607ddb-d195-48dd-a671-06aba5e4c5a1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:39.118435 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6f3a7c0a-54e7-40c1-a97c-92abbdbb15ef tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:39.119540 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6f3a7c0a-54e7-40c1-a97c-92abbdbb15ef tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:39.127297 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f3a7c0a-54e7-40c1-a97c-92abbdbb15ef tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:39.127953 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f3a7c0a-54e7-40c1-a97c-92abbdbb15ef tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:39.128575 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f3a7c0a-54e7-40c1-a97c-92abbdbb15ef tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:39.129002 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f3a7c0a-54e7-40c1-a97c-92abbdbb15ef tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:39.130490 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d0607ddb-d195-48dd-a671-06aba5e4c5a1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:39.138551 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d0607ddb-d195-48dd-a671-06aba5e4c5a1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.171328 Dec 15 14:05:39.139114 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 192/381] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:38 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:39.248208 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e9694945-4253-4fb0-b1a6-0c6ae060b3e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:39.249925 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e9694945-4253-4fb0-b1a6-0c6ae060b3e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:39.254124 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6f3a7c0a-54e7-40c1-a97c-92abbdbb15ef tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.139029 Dec 15 14:05:39.255208 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 190/382] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:39 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:39.265016 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e9694945-4253-4fb0-b1a6-0c6ae060b3e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:39.266198 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e9694945-4253-4fb0-b1a6-0c6ae060b3e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:39.268150 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e9694945-4253-4fb0-b1a6-0c6ae060b3e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:39.268589 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e9694945-4253-4fb0-b1a6-0c6ae060b3e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:39.366894 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e9694945-4253-4fb0-b1a6-0c6ae060b3e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 0.124948 Dec 15 14:05:39.367554 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 193/383] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:39 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:40.157015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-155ef1b5-23d0-46a3-a0ba-c2c0e589c37d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:40.157764 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-155ef1b5-23d0-46a3-a0ba-c2c0e589c37d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:40.165204 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-155ef1b5-23d0-46a3-a0ba-c2c0e589c37d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:40.165647 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-155ef1b5-23d0-46a3-a0ba-c2c0e589c37d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:40.166473 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-155ef1b5-23d0-46a3-a0ba-c2c0e589c37d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:40.166906 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-155ef1b5-23d0-46a3-a0ba-c2c0e589c37d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:40.273204 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-31b6d572-911a-46e9-9725-14e05fc780f9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:40.274264 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-31b6d572-911a-46e9-9725-14e05fc780f9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:40.281474 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31b6d572-911a-46e9-9725-14e05fc780f9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:40.281987 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31b6d572-911a-46e9-9725-14e05fc780f9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:40.282780 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31b6d572-911a-46e9-9725-14e05fc780f9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:40.283255 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31b6d572-911a-46e9-9725-14e05fc780f9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:40.329567 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-155ef1b5-23d0-46a3-a0ba-c2c0e589c37d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:40.340243 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-155ef1b5-23d0-46a3-a0ba-c2c0e589c37d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.187305 Dec 15 14:05:40.340717 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 191/384] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:40 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:40.379396 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1e856424-d285-40c5-86a8-e371d1026a83 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:40.380323 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1e856424-d285-40c5-86a8-e371d1026a83 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:40.387591 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e856424-d285-40c5-86a8-e371d1026a83 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:40.388224 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e856424-d285-40c5-86a8-e371d1026a83 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:40.389268 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e856424-d285-40c5-86a8-e371d1026a83 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:40.389937 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e856424-d285-40c5-86a8-e371d1026a83 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:46.263031 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-31b6d572-911a-46e9-9725-14e05fc780f9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 5.993686 Dec 15 14:05:46.263712 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 194/385] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:40 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 5996 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:05:46.268636 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-da784a4e-45f3-49e9-9dc3-66bc1b11569b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:46.269351 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-da784a4e-45f3-49e9-9dc3-66bc1b11569b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:46.277277 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da784a4e-45f3-49e9-9dc3-66bc1b11569b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:46.278057 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da784a4e-45f3-49e9-9dc3-66bc1b11569b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:46.278405 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1e856424-d285-40c5-86a8-e371d1026a83 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 5.903324 Dec 15 14:05:46.279058 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 192/386] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:40 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 5905 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:05:46.279485 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da784a4e-45f3-49e9-9dc3-66bc1b11569b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:46.280374 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da784a4e-45f3-49e9-9dc3-66bc1b11569b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:46.431681 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-da784a4e-45f3-49e9-9dc3-66bc1b11569b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:46.440205 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-da784a4e-45f3-49e9-9dc3-66bc1b11569b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.175011 Dec 15 14:05:46.440858 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 195/387] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:46 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:47.278365 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8ea91735-b62d-4902-ab6d-673a88ae8a75 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:47.279703 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8ea91735-b62d-4902-ab6d-673a88ae8a75 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:47.289320 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ea91735-b62d-4902-ab6d-673a88ae8a75 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:47.289823 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ea91735-b62d-4902-ab6d-673a88ae8a75 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:47.290622 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ea91735-b62d-4902-ab6d-673a88ae8a75 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:47.291061 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ea91735-b62d-4902-ab6d-673a88ae8a75 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:47.291361 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-53f43631-e99a-4c2d-acf7-a093fc65a0b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:47.292291 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-53f43631-e99a-4c2d-acf7-a093fc65a0b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:47.299581 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53f43631-e99a-4c2d-acf7-a093fc65a0b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:47.300034 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53f43631-e99a-4c2d-acf7-a093fc65a0b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:47.300913 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53f43631-e99a-4c2d-acf7-a093fc65a0b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:47.301484 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53f43631-e99a-4c2d-acf7-a093fc65a0b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:47.381317 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8ea91735-b62d-4902-ab6d-673a88ae8a75 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.108805 Dec 15 14:05:47.381995 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 193/388] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:47 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:47.403338 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-53f43631-e99a-4c2d-acf7-a093fc65a0b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 0.115445 Dec 15 14:05:47.403975 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 196/389] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:47 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:47.460386 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-61e00a58-6f74-4c22-8712-311fceeac8be tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:47.461029 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-61e00a58-6f74-4c22-8712-311fceeac8be tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:47.468015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61e00a58-6f74-4c22-8712-311fceeac8be tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:47.468460 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61e00a58-6f74-4c22-8712-311fceeac8be tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:47.469219 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61e00a58-6f74-4c22-8712-311fceeac8be tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:47.469689 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61e00a58-6f74-4c22-8712-311fceeac8be tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:47.613147 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-61e00a58-6f74-4c22-8712-311fceeac8be tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:47.620954 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-61e00a58-6f74-4c22-8712-311fceeac8be tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.165935 Dec 15 14:05:47.621561 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 194/390] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:47 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:48.398346 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-23a070e9-c2f5-4d9b-b794-7c270a080299 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:48.399257 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-23a070e9-c2f5-4d9b-b794-7c270a080299 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:48.408729 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-23a070e9-c2f5-4d9b-b794-7c270a080299 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:48.409177 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-23a070e9-c2f5-4d9b-b794-7c270a080299 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:48.410003 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-23a070e9-c2f5-4d9b-b794-7c270a080299 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:48.410468 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-23a070e9-c2f5-4d9b-b794-7c270a080299 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:48.416644 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-931c8401-e675-4e58-9ddd-83fa5fc05a8f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:48.417561 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-931c8401-e675-4e58-9ddd-83fa5fc05a8f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:48.429426 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-931c8401-e675-4e58-9ddd-83fa5fc05a8f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:48.429930 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-931c8401-e675-4e58-9ddd-83fa5fc05a8f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:48.430729 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-931c8401-e675-4e58-9ddd-83fa5fc05a8f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:48.431165 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-931c8401-e675-4e58-9ddd-83fa5fc05a8f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:48.551611 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-23a070e9-c2f5-4d9b-b794-7c270a080299 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.157689 Dec 15 14:05:48.552612 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 197/391] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:48 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:48.580006 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-931c8401-e675-4e58-9ddd-83fa5fc05a8f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 0.167645 Dec 15 14:05:48.580818 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 195/392] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:48 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:48.640953 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ef0eebaf-6f29-4782-95ed-e52b433b3c26 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:48.641981 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ef0eebaf-6f29-4782-95ed-e52b433b3c26 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:48.653271 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ef0eebaf-6f29-4782-95ed-e52b433b3c26 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:48.653892 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ef0eebaf-6f29-4782-95ed-e52b433b3c26 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:48.655045 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ef0eebaf-6f29-4782-95ed-e52b433b3c26 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:48.655673 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ef0eebaf-6f29-4782-95ed-e52b433b3c26 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:48.809424 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ef0eebaf-6f29-4782-95ed-e52b433b3c26 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:48.818813 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ef0eebaf-6f29-4782-95ed-e52b433b3c26 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.183352 Dec 15 14:05:48.819984 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 198/393] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:48 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:49.565201 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c0668cbe-18ae-42b2-b123-ab40a558515b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:49.566369 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c0668cbe-18ae-42b2-b123-ab40a558515b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:49.574278 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0668cbe-18ae-42b2-b123-ab40a558515b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:49.574733 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0668cbe-18ae-42b2-b123-ab40a558515b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:49.575555 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0668cbe-18ae-42b2-b123-ab40a558515b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:49.576001 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0668cbe-18ae-42b2-b123-ab40a558515b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:49.593816 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-847031c2-aa66-4444-ba5b-253a9dc33dc1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:49.594769 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-847031c2-aa66-4444-ba5b-253a9dc33dc1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:49.602331 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-847031c2-aa66-4444-ba5b-253a9dc33dc1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:49.602832 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-847031c2-aa66-4444-ba5b-253a9dc33dc1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:49.603627 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-847031c2-aa66-4444-ba5b-253a9dc33dc1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:49.604049 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-847031c2-aa66-4444-ba5b-253a9dc33dc1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:49.832674 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c0668cbe-18ae-42b2-b123-ab40a558515b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.271592 Dec 15 14:05:49.833643 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 196/394] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:49 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:49.838752 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bd33a0ed-5551-4976-b4e6-7cc207074833 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:49.839449 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bd33a0ed-5551-4976-b4e6-7cc207074833 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:49.846827 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd33a0ed-5551-4976-b4e6-7cc207074833 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:49.847286 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd33a0ed-5551-4976-b4e6-7cc207074833 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:49.849015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd33a0ed-5551-4976-b4e6-7cc207074833 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:49.849015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd33a0ed-5551-4976-b4e6-7cc207074833 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:49.861408 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-847031c2-aa66-4444-ba5b-253a9dc33dc1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 0.271388 Dec 15 14:05:49.866853 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 199/395] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:49 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:50.001785 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bd33a0ed-5551-4976-b4e6-7cc207074833 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:50.009485 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bd33a0ed-5551-4976-b4e6-7cc207074833 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.174565 Dec 15 14:05:50.010156 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 197/396] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:49 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:50.847185 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-daf1d7e1-e04c-4e6b-b17a-6e8a6cf5f8a4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:50.848583 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-daf1d7e1-e04c-4e6b-b17a-6e8a6cf5f8a4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:50.856903 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-daf1d7e1-e04c-4e6b-b17a-6e8a6cf5f8a4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:50.857347 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-daf1d7e1-e04c-4e6b-b17a-6e8a6cf5f8a4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:50.858184 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-daf1d7e1-e04c-4e6b-b17a-6e8a6cf5f8a4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:50.858613 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-daf1d7e1-e04c-4e6b-b17a-6e8a6cf5f8a4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:50.876480 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c7eb1de7-6193-47dd-b306-ca00edf96c1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:50.877353 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c7eb1de7-6193-47dd-b306-ca00edf96c1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:50.884943 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c7eb1de7-6193-47dd-b306-ca00edf96c1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:50.885389 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c7eb1de7-6193-47dd-b306-ca00edf96c1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:50.886250 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c7eb1de7-6193-47dd-b306-ca00edf96c1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:50.886686 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c7eb1de7-6193-47dd-b306-ca00edf96c1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:50.998713 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-daf1d7e1-e04c-4e6b-b17a-6e8a6cf5f8a4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.156775 Dec 15 14:05:50.999367 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 200/397] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:50 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:51.032752 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-01272453-ee2f-4458-8a45-91e8c7ff6ddf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:51.033453 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-01272453-ee2f-4458-8a45-91e8c7ff6ddf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:51.040694 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01272453-ee2f-4458-8a45-91e8c7ff6ddf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:51.041132 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01272453-ee2f-4458-8a45-91e8c7ff6ddf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:51.041944 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01272453-ee2f-4458-8a45-91e8c7ff6ddf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:51.042371 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01272453-ee2f-4458-8a45-91e8c7ff6ddf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:51.065535 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c7eb1de7-6193-47dd-b306-ca00edf96c1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 0.194768 Dec 15 14:05:51.066236 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 198/398] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:50 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:51.186035 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-01272453-ee2f-4458-8a45-91e8c7ff6ddf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:51.193590 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-01272453-ee2f-4458-8a45-91e8c7ff6ddf tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.164810 Dec 15 14:05:51.194196 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 201/399] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:51 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:52.010519 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1fc17b23-8ee4-4afa-ac8f-15af0d455a60 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:52.011583 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1fc17b23-8ee4-4afa-ac8f-15af0d455a60 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:52.019383 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1fc17b23-8ee4-4afa-ac8f-15af0d455a60 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:52.019864 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1fc17b23-8ee4-4afa-ac8f-15af0d455a60 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:52.020651 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1fc17b23-8ee4-4afa-ac8f-15af0d455a60 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:52.021089 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1fc17b23-8ee4-4afa-ac8f-15af0d455a60 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:52.080907 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d9e8a4c8-fde1-448a-a533-99df05c63c16 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:52.082441 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d9e8a4c8-fde1-448a-a533-99df05c63c16 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:52.090304 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9e8a4c8-fde1-448a-a533-99df05c63c16 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:52.090758 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9e8a4c8-fde1-448a-a533-99df05c63c16 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:52.091544 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9e8a4c8-fde1-448a-a533-99df05c63c16 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:52.091980 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9e8a4c8-fde1-448a-a533-99df05c63c16 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:52.135438 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1fc17b23-8ee4-4afa-ac8f-15af0d455a60 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.128888 Dec 15 14:05:52.136108 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 199/400] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:52 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:52.184618 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d9e8a4c8-fde1-448a-a533-99df05c63c16 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 0.110601 Dec 15 14:05:52.185325 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 202/401] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:52 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:05:52.212303 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d2f25347-3c01-4a28-bb6d-61b135afcf7d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:52.212928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d2f25347-3c01-4a28-bb6d-61b135afcf7d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:52.220570 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2f25347-3c01-4a28-bb6d-61b135afcf7d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:52.221018 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2f25347-3c01-4a28-bb6d-61b135afcf7d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:52.221836 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2f25347-3c01-4a28-bb6d-61b135afcf7d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:52.222273 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2f25347-3c01-4a28-bb6d-61b135afcf7d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:52.377450 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d2f25347-3c01-4a28-bb6d-61b135afcf7d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:52.386081 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d2f25347-3c01-4a28-bb6d-61b135afcf7d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.178406 Dec 15 14:05:52.386653 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 200/402] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:52 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:53.147985 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5f46cf63-4b8b-4c77-ade9-79e9d8a41815 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:53.149130 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5f46cf63-4b8b-4c77-ade9-79e9d8a41815 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:53.159925 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f46cf63-4b8b-4c77-ade9-79e9d8a41815 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:53.160608 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f46cf63-4b8b-4c77-ade9-79e9d8a41815 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:53.161684 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f46cf63-4b8b-4c77-ade9-79e9d8a41815 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:53.162147 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f46cf63-4b8b-4c77-ade9-79e9d8a41815 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:53.196764 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9f8fe6f3-68f8-43f9-91ae-a5894d682954 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:53.197578 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9f8fe6f3-68f8-43f9-91ae-a5894d682954 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:53.204401 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f8fe6f3-68f8-43f9-91ae-a5894d682954 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:53.204845 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f8fe6f3-68f8-43f9-91ae-a5894d682954 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:53.205696 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f8fe6f3-68f8-43f9-91ae-a5894d682954 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:53.206139 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f8fe6f3-68f8-43f9-91ae-a5894d682954 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:53.338892 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5f46cf63-4b8b-4c77-ade9-79e9d8a41815 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.194784 Dec 15 14:05:53.339850 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 203/403] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:53 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:53.403376 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ee07d1d0-e9ad-4d87-9f35-6d6b021e5499 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:53.404072 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ee07d1d0-e9ad-4d87-9f35-6d6b021e5499 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:53.411186 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee07d1d0-e9ad-4d87-9f35-6d6b021e5499 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:53.411607 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee07d1d0-e9ad-4d87-9f35-6d6b021e5499 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:53.412384 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee07d1d0-e9ad-4d87-9f35-6d6b021e5499 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:53.412819 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee07d1d0-e9ad-4d87-9f35-6d6b021e5499 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:53.503069 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9f8fe6f3-68f8-43f9-91ae-a5894d682954 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 0.309994 Dec 15 14:05:53.504364 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 201/404] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:53 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:53.573554 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ee07d1d0-e9ad-4d87-9f35-6d6b021e5499 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:53.582514 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ee07d1d0-e9ad-4d87-9f35-6d6b021e5499 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.183149 Dec 15 14:05:53.583082 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 204/405] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:53 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:05:54.352868 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1c93a8b3-d417-472b-9661-3710c14ff6c1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:54.353938 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1c93a8b3-d417-472b-9661-3710c14ff6c1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:54.363916 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c93a8b3-d417-472b-9661-3710c14ff6c1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:54.363916 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c93a8b3-d417-472b-9661-3710c14ff6c1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:54.370046 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c93a8b3-d417-472b-9661-3710c14ff6c1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:54.370553 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c93a8b3-d417-472b-9661-3710c14ff6c1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:54.519917 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-954ae01b-4446-4e88-9810-75dd441f4bf9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:54.522362 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-954ae01b-4446-4e88-9810-75dd441f4bf9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:54.529109 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-954ae01b-4446-4e88-9810-75dd441f4bf9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:54.529559 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-954ae01b-4446-4e88-9810-75dd441f4bf9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:54.530411 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-954ae01b-4446-4e88-9810-75dd441f4bf9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:54.530846 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-954ae01b-4446-4e88-9810-75dd441f4bf9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:54.598019 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1c93a8b3-d417-472b-9661-3710c14ff6c1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.250163 Dec 15 14:05:54.598835 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 202/406] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:54 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:54.604662 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-25da8ac7-9a6c-427e-a931-90eb541b4b36 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:54.605343 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-25da8ac7-9a6c-427e-a931-90eb541b4b36 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:54.612472 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-25da8ac7-9a6c-427e-a931-90eb541b4b36 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:54.612937 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-25da8ac7-9a6c-427e-a931-90eb541b4b36 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:54.613755 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-25da8ac7-9a6c-427e-a931-90eb541b4b36 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:54.614192 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-25da8ac7-9a6c-427e-a931-90eb541b4b36 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:54.758695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-25da8ac7-9a6c-427e-a931-90eb541b4b36 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:54.766953 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-25da8ac7-9a6c-427e-a931-90eb541b4b36 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.166873 Dec 15 14:05:54.767577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 203/407] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:54 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:54.865724 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-954ae01b-4446-4e88-9810-75dd441f4bf9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 0.352849 Dec 15 14:05:54.869902 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 205/408] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:54 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:55.609907 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-06011a04-1695-4a0d-92f7-cbe7cccea4e0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:55.610869 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-06011a04-1695-4a0d-92f7-cbe7cccea4e0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:55.617503 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-06011a04-1695-4a0d-92f7-cbe7cccea4e0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:55.617969 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-06011a04-1695-4a0d-92f7-cbe7cccea4e0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:55.618766 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-06011a04-1695-4a0d-92f7-cbe7cccea4e0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:55.619192 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-06011a04-1695-4a0d-92f7-cbe7cccea4e0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:55.785765 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1bc3bd2a-1f80-4c70-a59b-a5d05996c9a2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:55.786531 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1bc3bd2a-1f80-4c70-a59b-a5d05996c9a2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:55.794435 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1bc3bd2a-1f80-4c70-a59b-a5d05996c9a2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:55.794941 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1bc3bd2a-1f80-4c70-a59b-a5d05996c9a2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:55.795785 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1bc3bd2a-1f80-4c70-a59b-a5d05996c9a2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:55.796275 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1bc3bd2a-1f80-4c70-a59b-a5d05996c9a2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:55.935525 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1bc3bd2a-1f80-4c70-a59b-a5d05996c9a2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:55.943104 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1bc3bd2a-1f80-4c70-a59b-a5d05996c9a2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.162456 Dec 15 14:05:55.943680 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 206/409] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:55 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:55.948055 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0563fc80-faec-4788-8b1b-14332c690ee1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:55.948945 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0563fc80-faec-4788-8b1b-14332c690ee1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:55.954728 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0563fc80-faec-4788-8b1b-14332c690ee1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:55.955172 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0563fc80-faec-4788-8b1b-14332c690ee1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:55.955939 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0563fc80-faec-4788-8b1b-14332c690ee1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:55.956368 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0563fc80-faec-4788-8b1b-14332c690ee1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:56.086467 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-06011a04-1695-4a0d-92f7-cbe7cccea4e0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.479180 Dec 15 14:05:56.087589 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 204/410] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:55 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:56.960710 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8901ba50-8e7d-4e89-b49f-66c36631cc4c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:56.961733 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8901ba50-8e7d-4e89-b49f-66c36631cc4c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:56.968881 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8901ba50-8e7d-4e89-b49f-66c36631cc4c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:56.969338 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8901ba50-8e7d-4e89-b49f-66c36631cc4c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:56.970155 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8901ba50-8e7d-4e89-b49f-66c36631cc4c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:56.970591 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8901ba50-8e7d-4e89-b49f-66c36631cc4c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:57.140019 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8901ba50-8e7d-4e89-b49f-66c36631cc4c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:57.151008 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8901ba50-8e7d-4e89-b49f-66c36631cc4c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.194616 Dec 15 14:05:57.151589 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 205/411] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:56 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:57.156312 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5230632b-f9d5-49c3-954b-057c9a2a5e8c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:57.157228 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5230632b-f9d5-49c3-954b-057c9a2a5e8c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:57.163350 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5230632b-f9d5-49c3-954b-057c9a2a5e8c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:57.163816 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5230632b-f9d5-49c3-954b-057c9a2a5e8c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:57.164602 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5230632b-f9d5-49c3-954b-057c9a2a5e8c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:57.165041 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5230632b-f9d5-49c3-954b-057c9a2a5e8c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:57.490112 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0563fc80-faec-4788-8b1b-14332c690ee1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 1.544722 Dec 15 14:05:57.492124 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 207/412] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:55 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:57.516213 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5230632b-f9d5-49c3-954b-057c9a2a5e8c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.362630 Dec 15 14:05:57.517084 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 206/413] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:57 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:05:58.168370 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0da01b4f-49ec-4b6a-8c80-3407d54e0af4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:58.169061 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0da01b4f-49ec-4b6a-8c80-3407d54e0af4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:58.176622 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0da01b4f-49ec-4b6a-8c80-3407d54e0af4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:58.177077 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0da01b4f-49ec-4b6a-8c80-3407d54e0af4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:58.177900 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0da01b4f-49ec-4b6a-8c80-3407d54e0af4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:58.178336 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0da01b4f-49ec-4b6a-8c80-3407d54e0af4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:58.331214 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0da01b4f-49ec-4b6a-8c80-3407d54e0af4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:58.338650 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0da01b4f-49ec-4b6a-8c80-3407d54e0af4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.174820 Dec 15 14:05:58.339226 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 208/414] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:58 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:58.505793 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-90d32d78-c13b-4205-a4e1-35fe6828e2e7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:58.506866 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-90d32d78-c13b-4205-a4e1-35fe6828e2e7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:58.514964 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90d32d78-c13b-4205-a4e1-35fe6828e2e7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:58.515476 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90d32d78-c13b-4205-a4e1-35fe6828e2e7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:58.516389 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90d32d78-c13b-4205-a4e1-35fe6828e2e7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:58.516857 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90d32d78-c13b-4205-a4e1-35fe6828e2e7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:58.529899 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ec2324b1-1ec8-494a-8b1d-e0cd357c1f73 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:58.531001 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ec2324b1-1ec8-494a-8b1d-e0cd357c1f73 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:58.537575 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec2324b1-1ec8-494a-8b1d-e0cd357c1f73 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:58.538169 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec2324b1-1ec8-494a-8b1d-e0cd357c1f73 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:58.538995 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec2324b1-1ec8-494a-8b1d-e0cd357c1f73 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:58.539435 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec2324b1-1ec8-494a-8b1d-e0cd357c1f73 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:58.618248 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-90d32d78-c13b-4205-a4e1-35fe6828e2e7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 0.116279 Dec 15 14:05:58.619065 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 207/415] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:58 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:58.670105 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ec2324b1-1ec8-494a-8b1d-e0cd357c1f73 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.144485 Dec 15 14:05:58.670966 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 209/416] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:58 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:05:59.357141 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-de977f05-6247-4d13-86bf-b0f7b8bd4905 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:05:59.358328 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-de977f05-6247-4d13-86bf-b0f7b8bd4905 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:59.366451 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-de977f05-6247-4d13-86bf-b0f7b8bd4905 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:59.366929 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-de977f05-6247-4d13-86bf-b0f7b8bd4905 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:59.367728 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-de977f05-6247-4d13-86bf-b0f7b8bd4905 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:59.368173 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-de977f05-6247-4d13-86bf-b0f7b8bd4905 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:59.418603 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-11141661-18c4-4109-8919-e0e3ff38b631 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66f837d3-69ba-4669-98bc-fabb537d2071", "device": "/dev/sdb"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:59.420584 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-11141661-18c4-4109-8919-e0e3ff38b631 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:59.427687 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11141661-18c4-4109-8919-e0e3ff38b631 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:59.428218 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11141661-18c4-4109-8919-e0e3ff38b631 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:59.429087 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11141661-18c4-4109-8919-e0e3ff38b631 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:59.429716 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11141661-18c4-4109-8919-e0e3ff38b631 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:59.519042 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-de977f05-6247-4d13-86bf-b0f7b8bd4905 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:05:59.527260 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-de977f05-6247-4d13-86bf-b0f7b8bd4905 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.175086 Dec 15 14:05:59.527851 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 208/417] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:05:59 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:05:59.631183 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d17e98dd-b2c0-4924-9ff7-a69061eeb7f3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:59.632106 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d17e98dd-b2c0-4924-9ff7-a69061eeb7f3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:59.638722 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d17e98dd-b2c0-4924-9ff7-a69061eeb7f3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:59.639182 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d17e98dd-b2c0-4924-9ff7-a69061eeb7f3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:59.639947 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d17e98dd-b2c0-4924-9ff7-a69061eeb7f3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:59.640700 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d17e98dd-b2c0-4924-9ff7-a69061eeb7f3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:59.760235 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d17e98dd-b2c0-4924-9ff7-a69061eeb7f3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 0.132779 Dec 15 14:05:59.761149 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 209/418] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:05:59 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:05:59.772109 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-78309d65-a53e-420e-b389-a8914c3eb992 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:05:59.773280 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-78309d65-a53e-420e-b389-a8914c3eb992 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:05:59.785662 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-78309d65-a53e-420e-b389-a8914c3eb992 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:59.786314 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-78309d65-a53e-420e-b389-a8914c3eb992 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:59.787140 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-78309d65-a53e-420e-b389-a8914c3eb992 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:05:59.787561 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-78309d65-a53e-420e-b389-a8914c3eb992 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:05:59.854085 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-11141661-18c4-4109-8919-e0e3ff38b631 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "POST /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.438911 Dec 15 14:05:59.857701 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 210/419] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Dec 15 14:05:59 2021] POST /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a/os-volume_attachments => generated 194 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:05:59.885303 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-78309d65-a53e-420e-b389-a8914c3eb992 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.117537 Dec 15 14:05:59.886095 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 210/420] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:05:59 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:00.546949 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0eb8ffe8-7ffe-439e-950b-af75002301d8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:00.547734 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0eb8ffe8-7ffe-439e-950b-af75002301d8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:00.558406 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0eb8ffe8-7ffe-439e-950b-af75002301d8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:00.558902 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0eb8ffe8-7ffe-439e-950b-af75002301d8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:00.559780 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0eb8ffe8-7ffe-439e-950b-af75002301d8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:00.560255 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0eb8ffe8-7ffe-439e-950b-af75002301d8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:00.703399 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0eb8ffe8-7ffe-439e-950b-af75002301d8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:06:00.715099 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0eb8ffe8-7ffe-439e-950b-af75002301d8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.172825 Dec 15 14:06:00.715655 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 211/421] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:06:00 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:00.775659 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b4bec0af-aef2-4345-b9de-57c4c35ea7cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:00.777144 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b4bec0af-aef2-4345-b9de-57c4c35ea7cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:00.784525 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4bec0af-aef2-4345-b9de-57c4c35ea7cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:00.784979 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4bec0af-aef2-4345-b9de-57c4c35ea7cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:00.785848 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4bec0af-aef2-4345-b9de-57c4c35ea7cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:00.786277 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4bec0af-aef2-4345-b9de-57c4c35ea7cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:00.900849 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7f3505d8-2322-4500-9d41-7023baac4abc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:00.902333 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7f3505d8-2322-4500-9d41-7023baac4abc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:00.909289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f3505d8-2322-4500-9d41-7023baac4abc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:00.909769 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f3505d8-2322-4500-9d41-7023baac4abc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:00.910551 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f3505d8-2322-4500-9d41-7023baac4abc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:00.910986 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f3505d8-2322-4500-9d41-7023baac4abc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:01.027706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b4bec0af-aef2-4345-b9de-57c4c35ea7cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 0.258169 Dec 15 14:06:01.028546 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 211/422] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:00 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:01.064129 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7f3505d8-2322-4500-9d41-7023baac4abc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.168989 Dec 15 14:06:01.064778 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 212/423] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:00 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:01.737521 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-abfd8448-dd5d-4f8a-96ed-2f95d11e2545 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:01.738262 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-abfd8448-dd5d-4f8a-96ed-2f95d11e2545 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:01.745257 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abfd8448-dd5d-4f8a-96ed-2f95d11e2545 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:01.745749 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abfd8448-dd5d-4f8a-96ed-2f95d11e2545 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:01.746857 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abfd8448-dd5d-4f8a-96ed-2f95d11e2545 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:01.747308 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abfd8448-dd5d-4f8a-96ed-2f95d11e2545 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:01.895634 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-abfd8448-dd5d-4f8a-96ed-2f95d11e2545 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:06:01.903910 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-abfd8448-dd5d-4f8a-96ed-2f95d11e2545 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1501 microversion: 2.1 time: 0.170429 Dec 15 14:06:01.904497 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 212/424] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:06:01 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1501 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:01.922535 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-012f39bc-742f-42a3-b1b8-9c84ab2d26d1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c8eed01-7f6e-470d-804f-23ba015f544b"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:01.924098 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-012f39bc-742f-42a3-b1b8-9c84ab2d26d1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:01.932646 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-012f39bc-742f-42a3-b1b8-9c84ab2d26d1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:01.933400 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-012f39bc-742f-42a3-b1b8-9c84ab2d26d1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:01.934538 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-012f39bc-742f-42a3-b1b8-9c84ab2d26d1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:01.934732 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-012f39bc-742f-42a3-b1b8-9c84ab2d26d1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:01.975179 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-012f39bc-742f-42a3-b1b8-9c84ab2d26d1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] HTTP exception thrown: Cannot 'attach_volume' instance bfccdaf0-2b79-4ace-a816-8c76eba7f48b while it is in vm_state rescued Dec 15 14:06:01.975179 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-012f39bc-742f-42a3-b1b8-9c84ab2d26d1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Returning 409 to user: Cannot 'attach_volume' instance bfccdaf0-2b79-4ace-a816-8c76eba7f48b while it is in vm_state rescued {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:06:01.975424 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-012f39bc-742f-42a3-b1b8-9c84ab2d26d1 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "POST /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.058010 Dec 15 14:06:01.976362 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 213/425] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Dec 15 14:06:01 2021] POST /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b/os-volume_attachments => generated 152 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 15 14:06:01.987439 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5c68d870-3320-439d-b1aa-2b1a748beb49 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:01.989070 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5c68d870-3320-439d-b1aa-2b1a748beb49 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:01.995678 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5c68d870-3320-439d-b1aa-2b1a748beb49 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:01.997074 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5c68d870-3320-439d-b1aa-2b1a748beb49 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:01.997906 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5c68d870-3320-439d-b1aa-2b1a748beb49 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:01.998551 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5c68d870-3320-439d-b1aa-2b1a748beb49 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:02.040920 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e8662b7f-ff04-4fd2-8bfb-545d21084d04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:02.042535 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e8662b7f-ff04-4fd2-8bfb-545d21084d04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:02.049909 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8662b7f-ff04-4fd2-8bfb-545d21084d04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:02.057883 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8662b7f-ff04-4fd2-8bfb-545d21084d04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:02.059410 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8662b7f-ff04-4fd2-8bfb-545d21084d04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:02.060038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8662b7f-ff04-4fd2-8bfb-545d21084d04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:02.076603 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5c68d870-3320-439d-b1aa-2b1a748beb49 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "POST /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b/action" status: 202 len: 0 microversion: 2.1 time: 0.093832 Dec 15 14:06:02.077412 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 213/426] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:01 2021] POST /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:02.082461 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e0db5ac6-e149-49d1-9585-e5f455b49014 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:02.083782 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e0db5ac6-e149-49d1-9585-e5f455b49014 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:02.091289 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e0db5ac6-e149-49d1-9585-e5f455b49014 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:02.091808 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e0db5ac6-e149-49d1-9585-e5f455b49014 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:02.092666 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e0db5ac6-e149-49d1-9585-e5f455b49014 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:02.093354 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e0db5ac6-e149-49d1-9585-e5f455b49014 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:02.177422 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e0db5ac6-e149-49d1-9585-e5f455b49014 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 0.098551 Dec 15 14:06:02.178015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 214/427] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:02 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:02.182829 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0f8b0466-570e-40f0-8a1d-3493aff0f44e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:02.183709 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0f8b0466-570e-40f0-8a1d-3493aff0f44e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:02.191169 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0f8b0466-570e-40f0-8a1d-3493aff0f44e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:02.191623 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0f8b0466-570e-40f0-8a1d-3493aff0f44e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:02.192448 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0f8b0466-570e-40f0-8a1d-3493aff0f44e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:02.192884 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0f8b0466-570e-40f0-8a1d-3493aff0f44e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:02.233413 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e8662b7f-ff04-4fd2-8bfb-545d21084d04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 0.196172 Dec 15 14:06:02.234958 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 214/428] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:02 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:02.451416 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0f8b0466-570e-40f0-8a1d-3493aff0f44e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:06:02.459760 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0f8b0466-570e-40f0-8a1d-3493aff0f44e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1509 microversion: 2.1 time: 0.280609 Dec 15 14:06:02.460350 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 215/429] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:06:02 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1509 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:03.191865 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-abb5b854-9e64-4d81-9d81-941231182044 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:03.193038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-abb5b854-9e64-4d81-9d81-941231182044 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:03.201659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-abb5b854-9e64-4d81-9d81-941231182044 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:03.202223 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-abb5b854-9e64-4d81-9d81-941231182044 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:03.203160 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-abb5b854-9e64-4d81-9d81-941231182044 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:03.203715 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-abb5b854-9e64-4d81-9d81-941231182044 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:03.246370 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-43f994db-53f4-49de-a746-166f237c0448 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:03.247142 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-43f994db-53f4-49de-a746-166f237c0448 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:03.254493 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-43f994db-53f4-49de-a746-166f237c0448 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:03.254947 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-43f994db-53f4-49de-a746-166f237c0448 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:03.255740 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-43f994db-53f4-49de-a746-166f237c0448 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:03.256182 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-43f994db-53f4-49de-a746-166f237c0448 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:07.102579 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-abb5b854-9e64-4d81-9d81-941231182044 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28145 microversion: 2.1 time: 3.915331 Dec 15 14:06:07.103300 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 215/430] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:03 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28145 bytes in 3917 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:07.108716 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6f543a11-8e0d-4036-9fe5-7c77142245c9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:07.109424 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6f543a11-8e0d-4036-9fe5-7c77142245c9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:07.117080 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f543a11-8e0d-4036-9fe5-7c77142245c9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:07.117555 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f543a11-8e0d-4036-9fe5-7c77142245c9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:07.118370 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f543a11-8e0d-4036-9fe5-7c77142245c9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:07.118811 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f543a11-8e0d-4036-9fe5-7c77142245c9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:07.129639 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-43f994db-53f4-49de-a746-166f237c0448 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28174 microversion: 2.20 time: 3.887353 Dec 15 14:06:07.133653 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 216/431] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:03 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28174 bytes in 3889 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:07.269156 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6f543a11-8e0d-4036-9fe5-7c77142245c9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:06:07.277417 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6f543a11-8e0d-4036-9fe5-7c77142245c9 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1509 microversion: 2.1 time: 0.173028 Dec 15 14:06:07.278031 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 216/432] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:06:07 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:08.116313 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8773e93b-6ea5-4962-b3dc-0544da3fd4b7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:08.117307 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8773e93b-6ea5-4962-b3dc-0544da3fd4b7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:08.124977 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8773e93b-6ea5-4962-b3dc-0544da3fd4b7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:08.125422 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8773e93b-6ea5-4962-b3dc-0544da3fd4b7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:08.126254 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8773e93b-6ea5-4962-b3dc-0544da3fd4b7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:08.126658 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8773e93b-6ea5-4962-b3dc-0544da3fd4b7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:08.142482 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-68e5ea06-4db0-4208-bd09-403be812721d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:08.143462 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-68e5ea06-4db0-4208-bd09-403be812721d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:08.151810 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68e5ea06-4db0-4208-bd09-403be812721d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:08.152437 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68e5ea06-4db0-4208-bd09-403be812721d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:08.153639 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68e5ea06-4db0-4208-bd09-403be812721d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:08.154209 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68e5ea06-4db0-4208-bd09-403be812721d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:19.660858 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8773e93b-6ea5-4962-b3dc-0544da3fd4b7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28436 microversion: 2.1 time: 11.548331 Dec 15 14:06:19.661998 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 217/433] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:08 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28436 bytes in 11551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:19.669984 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-efdf4abd-798e-4f25-9af9-3be978f61764 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:19.671132 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-efdf4abd-798e-4f25-9af9-3be978f61764 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:19.682861 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-efdf4abd-798e-4f25-9af9-3be978f61764 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:19.683193 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-68e5ea06-4db0-4208-bd09-403be812721d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28465 microversion: 2.20 time: 11.545089 Dec 15 14:06:19.683689 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-efdf4abd-798e-4f25-9af9-3be978f61764 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:19.684070 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 217/434] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:08 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28465 bytes in 11547 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:06:19.684482 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-efdf4abd-798e-4f25-9af9-3be978f61764 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:19.684921 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-efdf4abd-798e-4f25-9af9-3be978f61764 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:19.828369 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-efdf4abd-798e-4f25-9af9-3be978f61764 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:06:19.836247 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-efdf4abd-798e-4f25-9af9-3be978f61764 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1509 microversion: 2.1 time: 0.172822 Dec 15 14:06:19.836873 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 218/435] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:06:19 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:20.675829 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5ee4ac61-bee0-45ec-af07-38f76a6304b7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:20.676785 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5ee4ac61-bee0-45ec-af07-38f76a6304b7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:20.684151 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ee4ac61-bee0-45ec-af07-38f76a6304b7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:20.684758 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ee4ac61-bee0-45ec-af07-38f76a6304b7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:20.685363 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ee4ac61-bee0-45ec-af07-38f76a6304b7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:20.685836 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ee4ac61-bee0-45ec-af07-38f76a6304b7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:20.695945 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-614487c0-e247-4712-aa19-ad544e27799f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:20.696986 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-614487c0-e247-4712-aa19-ad544e27799f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:20.703827 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-614487c0-e247-4712-aa19-ad544e27799f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:20.704253 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-614487c0-e247-4712-aa19-ad544e27799f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:20.705208 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-614487c0-e247-4712-aa19-ad544e27799f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:20.705742 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-614487c0-e247-4712-aa19-ad544e27799f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:20.808579 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5ee4ac61-bee0-45ec-af07-38f76a6304b7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28541 microversion: 2.1 time: 0.137193 Dec 15 14:06:20.809252 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 218/436] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:20 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28541 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:20.846504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-614487c0-e247-4712-aa19-ad544e27799f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 28784 microversion: 2.20 time: 0.154077 Dec 15 14:06:20.847195 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 219/437] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:20 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 28784 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:20.856761 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-89d7e0f1-283e-4741-b8dc-a70e0f0cd0f0 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:20.857975 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-89d7e0f1-283e-4741-b8dc-a70e0f0cd0f0 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:20.866443 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89d7e0f1-283e-4741-b8dc-a70e0f0cd0f0 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:20.866888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89d7e0f1-283e-4741-b8dc-a70e0f0cd0f0 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:20.867674 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89d7e0f1-283e-4741-b8dc-a70e0f0cd0f0 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:20.868106 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89d7e0f1-283e-4741-b8dc-a70e0f0cd0f0 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:21.009822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-89d7e0f1-283e-4741-b8dc-a70e0f0cd0f0 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:06:21.021315 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-89d7e0f1-283e-4741-b8dc-a70e0f0cd0f0 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1509 microversion: 2.1 time: 0.170694 Dec 15 14:06:21.021766 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 219/438] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:06:20 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:21.821053 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-20e79ae6-f9dd-440f-994e-17aafd6b7e0e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:21.822147 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-20e79ae6-f9dd-440f-994e-17aafd6b7e0e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:21.828652 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20e79ae6-f9dd-440f-994e-17aafd6b7e0e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:21.829241 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20e79ae6-f9dd-440f-994e-17aafd6b7e0e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:21.830143 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20e79ae6-f9dd-440f-994e-17aafd6b7e0e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:21.830563 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20e79ae6-f9dd-440f-994e-17aafd6b7e0e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:21.858747 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-19da66c2-dab2-44bd-9d3f-865ea80b9979 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:21.859740 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-19da66c2-dab2-44bd-9d3f-865ea80b9979 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:21.866794 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-19da66c2-dab2-44bd-9d3f-865ea80b9979 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:21.867476 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-19da66c2-dab2-44bd-9d3f-865ea80b9979 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:21.868448 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-19da66c2-dab2-44bd-9d3f-865ea80b9979 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:21.868901 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-19da66c2-dab2-44bd-9d3f-865ea80b9979 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:21.953869 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-20e79ae6-f9dd-440f-994e-17aafd6b7e0e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28847 microversion: 2.1 time: 0.136528 Dec 15 14:06:21.954681 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 220/439] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:21 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28847 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:06:22.040375 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-29b79771-916f-4548-a03f-ee9bc8ab7682 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:22.041043 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-29b79771-916f-4548-a03f-ee9bc8ab7682 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:22.046724 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-19da66c2-dab2-44bd-9d3f-865ea80b9979 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.191776 Dec 15 14:06:22.048860 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 220/440] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:21 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:22.049600 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-29b79771-916f-4548-a03f-ee9bc8ab7682 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:22.050150 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-29b79771-916f-4548-a03f-ee9bc8ab7682 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:22.051075 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-29b79771-916f-4548-a03f-ee9bc8ab7682 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:22.051577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-29b79771-916f-4548-a03f-ee9bc8ab7682 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:22.196247 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-29b79771-916f-4548-a03f-ee9bc8ab7682 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:06:22.204658 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-29b79771-916f-4548-a03f-ee9bc8ab7682 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1509 microversion: 2.1 time: 0.168870 Dec 15 14:06:22.205716 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 221/441] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:06:22 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:22.970618 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-047f0741-b1a7-4aed-8766-3fd0863e7f46 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:22.971685 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-047f0741-b1a7-4aed-8766-3fd0863e7f46 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:22.978989 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-047f0741-b1a7-4aed-8766-3fd0863e7f46 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:22.979448 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-047f0741-b1a7-4aed-8766-3fd0863e7f46 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:22.980582 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-047f0741-b1a7-4aed-8766-3fd0863e7f46 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:22.981021 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-047f0741-b1a7-4aed-8766-3fd0863e7f46 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:23.058685 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c59ca042-3a10-40d5-b8f8-5103f0489bad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:23.059610 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c59ca042-3a10-40d5-b8f8-5103f0489bad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:23.066770 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c59ca042-3a10-40d5-b8f8-5103f0489bad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:23.067143 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c59ca042-3a10-40d5-b8f8-5103f0489bad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:23.067902 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c59ca042-3a10-40d5-b8f8-5103f0489bad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:23.068330 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c59ca042-3a10-40d5-b8f8-5103f0489bad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:26.745348 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-047f0741-b1a7-4aed-8766-3fd0863e7f46 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 3.780932 Dec 15 14:06:26.745975 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 221/442] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:22 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 3783 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:06:26.751346 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1b17ffb7-6020-471f-91b2-95c837fa44af tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:26.751647 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1b17ffb7-6020-471f-91b2-95c837fa44af tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:26.757746 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c59ca042-3a10-40d5-b8f8-5103f0489bad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 3.702574 Dec 15 14:06:26.759084 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 222/443] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:23 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 3704 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:26.759607 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b17ffb7-6020-471f-91b2-95c837fa44af tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:26.759994 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b17ffb7-6020-471f-91b2-95c837fa44af tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:26.760782 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b17ffb7-6020-471f-91b2-95c837fa44af tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:26.766030 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b17ffb7-6020-471f-91b2-95c837fa44af tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:26.908287 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1b17ffb7-6020-471f-91b2-95c837fa44af tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:06:26.915648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1b17ffb7-6020-471f-91b2-95c837fa44af tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1515 microversion: 2.1 time: 0.168577 Dec 15 14:06:26.916230 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 222/444] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:06:26 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:27.760300 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-baf7bdea-e1bd-4dc5-bc38-f787c21db236 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:27.761526 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-baf7bdea-e1bd-4dc5-bc38-f787c21db236 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:27.769078 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-baf7bdea-e1bd-4dc5-bc38-f787c21db236 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:27.769572 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-baf7bdea-e1bd-4dc5-bc38-f787c21db236 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:27.770175 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-60a0b642-112f-4755-97df-37c75c66dc98 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:27.770650 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-baf7bdea-e1bd-4dc5-bc38-f787c21db236 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:27.770752 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-baf7bdea-e1bd-4dc5-bc38-f787c21db236 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:27.771287 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-60a0b642-112f-4755-97df-37c75c66dc98 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:27.778485 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60a0b642-112f-4755-97df-37c75c66dc98 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:27.779024 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60a0b642-112f-4755-97df-37c75c66dc98 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:27.780148 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60a0b642-112f-4755-97df-37c75c66dc98 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:27.780602 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60a0b642-112f-4755-97df-37c75c66dc98 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:27.886372 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-baf7bdea-e1bd-4dc5-bc38-f787c21db236 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.132214 Dec 15 14:06:27.886944 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 223/445] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:27 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:27.897649 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-60a0b642-112f-4755-97df-37c75c66dc98 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.131477 Dec 15 14:06:27.898605 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 223/446] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:27 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:06:28.902090 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6d92582f-6f91-42a4-8fec-55fc53c092d7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:28.903540 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6d92582f-6f91-42a4-8fec-55fc53c092d7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:28.911322 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3693fb61-e060-40a7-810b-042ba00bba26 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:28.912304 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d92582f-6f91-42a4-8fec-55fc53c092d7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:28.912464 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3693fb61-e060-40a7-810b-042ba00bba26 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:28.912759 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d92582f-6f91-42a4-8fec-55fc53c092d7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:28.913559 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d92582f-6f91-42a4-8fec-55fc53c092d7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:28.914033 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d92582f-6f91-42a4-8fec-55fc53c092d7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:28.919631 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3693fb61-e060-40a7-810b-042ba00bba26 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:28.920082 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3693fb61-e060-40a7-810b-042ba00bba26 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:28.920860 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3693fb61-e060-40a7-810b-042ba00bba26 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:28.921291 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3693fb61-e060-40a7-810b-042ba00bba26 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:32.696997 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3693fb61-e060-40a7-810b-042ba00bba26 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 3.790314 Dec 15 14:06:32.697662 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 224/447] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:28 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 3792 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:32.707422 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6d92582f-6f91-42a4-8fec-55fc53c092d7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 3.811054 Dec 15 14:06:32.708342 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 224/448] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:28 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 3813 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:33.712268 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bb0baf9a-616f-45d4-a7df-fa5f3338ea0f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:33.713402 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bb0baf9a-616f-45d4-a7df-fa5f3338ea0f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:33.722857 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0c821436-9c78-47ac-a728-d8468b700375 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:33.723485 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb0baf9a-616f-45d4-a7df-fa5f3338ea0f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:33.723764 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb0baf9a-616f-45d4-a7df-fa5f3338ea0f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:33.724099 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0c821436-9c78-47ac-a728-d8468b700375 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:33.724714 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb0baf9a-616f-45d4-a7df-fa5f3338ea0f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:33.725245 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb0baf9a-616f-45d4-a7df-fa5f3338ea0f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:33.734418 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0c821436-9c78-47ac-a728-d8468b700375 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:33.734978 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0c821436-9c78-47ac-a728-d8468b700375 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:33.736618 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0c821436-9c78-47ac-a728-d8468b700375 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:33.737043 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0c821436-9c78-47ac-a728-d8468b700375 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:33.823603 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bb0baf9a-616f-45d4-a7df-fa5f3338ea0f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.115963 Dec 15 14:06:33.824375 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 225/449] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:33 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:33.835693 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0c821436-9c78-47ac-a728-d8468b700375 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.118079 Dec 15 14:06:33.836359 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 225/450] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:33 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:34.542392 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6a672ca2-5ef7-4798-819a-a57dd1e2fa9d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:34.543080 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6a672ca2-5ef7-4798-819a-a57dd1e2fa9d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:34.550784 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6a672ca2-5ef7-4798-819a-a57dd1e2fa9d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:34.551225 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6a672ca2-5ef7-4798-819a-a57dd1e2fa9d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:34.552004 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6a672ca2-5ef7-4798-819a-a57dd1e2fa9d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:34.552444 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6a672ca2-5ef7-4798-819a-a57dd1e2fa9d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:34.698749 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6a672ca2-5ef7-4798-819a-a57dd1e2fa9d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:06:34.712134 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6a672ca2-5ef7-4798-819a-a57dd1e2fa9d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1515 microversion: 2.1 time: 0.173272 Dec 15 14:06:34.712916 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 226/451] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:06:34 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:34.729520 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2a97597f-cc47-4b20-9928-cdfa93726edb tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "248c6e96-48f0-482f-ba8e-2bdb42ffe110"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:34.731082 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2a97597f-cc47-4b20-9928-cdfa93726edb tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:34.738421 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2a97597f-cc47-4b20-9928-cdfa93726edb tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:34.738864 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2a97597f-cc47-4b20-9928-cdfa93726edb tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:34.739629 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2a97597f-cc47-4b20-9928-cdfa93726edb tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:34.740091 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2a97597f-cc47-4b20-9928-cdfa93726edb tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:34.836984 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1bf72fd5-68c6-4c85-bdde-cc7bcc16425f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:34.837948 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1bf72fd5-68c6-4c85-bdde-cc7bcc16425f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:34.845946 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1bf72fd5-68c6-4c85-bdde-cc7bcc16425f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:34.846422 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1bf72fd5-68c6-4c85-bdde-cc7bcc16425f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:34.847209 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1bf72fd5-68c6-4c85-bdde-cc7bcc16425f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:34.847668 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1bf72fd5-68c6-4c85-bdde-cc7bcc16425f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:38.622623 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1bf72fd5-68c6-4c85-bdde-cc7bcc16425f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 3.788709 Dec 15 14:06:38.624248 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 227/452] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:34 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 3791 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:38.630656 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0946e009-b439-490e-97d7-b1183d759195 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:38.631762 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0946e009-b439-490e-97d7-b1183d759195 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:38.639088 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0946e009-b439-490e-97d7-b1183d759195 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:38.639582 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0946e009-b439-490e-97d7-b1183d759195 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:38.640389 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0946e009-b439-490e-97d7-b1183d759195 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:38.640899 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0946e009-b439-490e-97d7-b1183d759195 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:38.757322 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2a97597f-cc47-4b20-9928-cdfa93726edb tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "POST /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.031955 Dec 15 14:06:38.760097 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0946e009-b439-490e-97d7-b1183d759195 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.134259 Dec 15 14:06:38.761802 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 228/453] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:38 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:38.762770 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 226/454] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Dec 15 14:06:34 2021] POST /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b/os-volume_attachments => generated 194 bytes in 4038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:06:39.640997 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9f23b707-ad44-4c73-8bbc-250a52a213f1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:39.642756 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9f23b707-ad44-4c73-8bbc-250a52a213f1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:39.649734 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f23b707-ad44-4c73-8bbc-250a52a213f1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:39.650202 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f23b707-ad44-4c73-8bbc-250a52a213f1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:39.650976 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f23b707-ad44-4c73-8bbc-250a52a213f1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:39.651422 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f23b707-ad44-4c73-8bbc-250a52a213f1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:39.772315 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c6d68a3c-79d5-407c-96f3-fe2a52ef6817 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:39.774097 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c6d68a3c-79d5-407c-96f3-fe2a52ef6817 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:39.781997 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c6d68a3c-79d5-407c-96f3-fe2a52ef6817 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:39.782440 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c6d68a3c-79d5-407c-96f3-fe2a52ef6817 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:39.783266 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c6d68a3c-79d5-407c-96f3-fe2a52ef6817 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:39.783977 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c6d68a3c-79d5-407c-96f3-fe2a52ef6817 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:39.803249 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9f23b707-ad44-4c73-8bbc-250a52a213f1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.169189 Dec 15 14:06:39.805216 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 229/455] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:39 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:39.885569 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c6d68a3c-79d5-407c-96f3-fe2a52ef6817 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.117028 Dec 15 14:06:39.886293 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 227/456] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:39 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:40.816414 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e8ad3a6f-8075-4167-8cc0-b1f37ec636b2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:40.817536 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e8ad3a6f-8075-4167-8cc0-b1f37ec636b2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:40.825334 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8ad3a6f-8075-4167-8cc0-b1f37ec636b2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:40.825974 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8ad3a6f-8075-4167-8cc0-b1f37ec636b2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:40.826767 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8ad3a6f-8075-4167-8cc0-b1f37ec636b2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:40.827208 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8ad3a6f-8075-4167-8cc0-b1f37ec636b2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:40.897023 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-697eb8cc-8604-4e06-84de-075037a9caa5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:40.898958 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-697eb8cc-8604-4e06-84de-075037a9caa5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:40.906530 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-697eb8cc-8604-4e06-84de-075037a9caa5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:40.907111 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-697eb8cc-8604-4e06-84de-075037a9caa5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:40.908244 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-697eb8cc-8604-4e06-84de-075037a9caa5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:40.908989 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-697eb8cc-8604-4e06-84de-075037a9caa5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:42.774008 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:06:42.774663 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:06:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action (ip 10.222.0.42) !!! Dec 15 14:06:44.773596 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e8ad3a6f-8075-4167-8cc0-b1f37ec636b2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 3.961460 Dec 15 14:06:44.774499 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 230/457] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:40 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 3963 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:44.779162 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-697eb8cc-8604-4e06-84de-075037a9caa5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 3.886206 Dec 15 14:06:44.779833 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 228/458] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:40 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 3888 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:06:45.786470 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0225da11-6317-43a3-a47e-53c99722ce40 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:45.787592 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0225da11-6317-43a3-a47e-53c99722ce40 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:45.794310 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-96b01f71-61c6-49f4-af9d-e0aa7f1f9a1a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:45.795448 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-96b01f71-61c6-49f4-af9d-e0aa7f1f9a1a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:45.795705 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0225da11-6317-43a3-a47e-53c99722ce40 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:45.796164 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0225da11-6317-43a3-a47e-53c99722ce40 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:45.796950 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0225da11-6317-43a3-a47e-53c99722ce40 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:45.797556 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0225da11-6317-43a3-a47e-53c99722ce40 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:45.801812 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96b01f71-61c6-49f4-af9d-e0aa7f1f9a1a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:45.802257 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96b01f71-61c6-49f4-af9d-e0aa7f1f9a1a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:45.803056 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96b01f71-61c6-49f4-af9d-e0aa7f1f9a1a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:45.803490 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96b01f71-61c6-49f4-af9d-e0aa7f1f9a1a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:45.905987 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0225da11-6317-43a3-a47e-53c99722ce40 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.123515 Dec 15 14:06:45.906675 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 231/459] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:45 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:45.917683 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-96b01f71-61c6-49f4-af9d-e0aa7f1f9a1a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.130365 Dec 15 14:06:45.918326 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 229/460] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:45 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:46.918298 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8563f714-f294-437b-8fac-ea4629d87895 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:46.919286 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8563f714-f294-437b-8fac-ea4629d87895 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:46.926669 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8563f714-f294-437b-8fac-ea4629d87895 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:46.927104 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8563f714-f294-437b-8fac-ea4629d87895 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:46.927883 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8563f714-f294-437b-8fac-ea4629d87895 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:46.928311 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8563f714-f294-437b-8fac-ea4629d87895 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:46.930149 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e7e09c13-c399-4243-bc31-9f29fb7436e5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:46.931191 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e7e09c13-c399-4243-bc31-9f29fb7436e5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:46.938211 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e7e09c13-c399-4243-bc31-9f29fb7436e5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:46.938661 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e7e09c13-c399-4243-bc31-9f29fb7436e5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:46.939450 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e7e09c13-c399-4243-bc31-9f29fb7436e5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:46.939887 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e7e09c13-c399-4243-bc31-9f29fb7436e5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:47.019241 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8563f714-f294-437b-8fac-ea4629d87895 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.104852 Dec 15 14:06:47.019900 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 232/461] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:46 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:47.043155 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e7e09c13-c399-4243-bc31-9f29fb7436e5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.116916 Dec 15 14:06:47.043726 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 230/462] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:46 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:06:48.031567 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-af47b0b9-7ef4-418b-bef9-d45fcaed522a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:48.032656 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-af47b0b9-7ef4-418b-bef9-d45fcaed522a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:48.040132 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af47b0b9-7ef4-418b-bef9-d45fcaed522a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:48.040576 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af47b0b9-7ef4-418b-bef9-d45fcaed522a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:48.041416 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af47b0b9-7ef4-418b-bef9-d45fcaed522a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:48.041892 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af47b0b9-7ef4-418b-bef9-d45fcaed522a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:48.056332 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-195cd010-763d-4d2f-90c8-c3884151ddf4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:48.057373 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-195cd010-763d-4d2f-90c8-c3884151ddf4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:48.069587 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-195cd010-763d-4d2f-90c8-c3884151ddf4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:48.070081 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-195cd010-763d-4d2f-90c8-c3884151ddf4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:48.071011 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-195cd010-763d-4d2f-90c8-c3884151ddf4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:48.071475 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-195cd010-763d-4d2f-90c8-c3884151ddf4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:48.153620 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-af47b0b9-7ef4-418b-bef9-d45fcaed522a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.126153 Dec 15 14:06:48.154307 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 233/463] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:48 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:48.169642 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-195cd010-763d-4d2f-90c8-c3884151ddf4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.117583 Dec 15 14:06:48.170472 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 231/464] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:48 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:06:48.577517 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-60155ca3-bb55-4a56-8505-0db4b11bd097 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1232706579", "imageRef": "9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7", "flavorRef": "452"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:48.634394 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-60155ca3-bb55-4a56-8505-0db4b11bd097 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] validate_networks() for None {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:06:48.951613 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:06:48.952211 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:06:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:06:49.167505 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d612929d-5a42-40e9-90d2-fe86d9b49719 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:49.168507 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d612929d-5a42-40e9-90d2-fe86d9b49719 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:49.177313 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d612929d-5a42-40e9-90d2-fe86d9b49719 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:49.177809 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d612929d-5a42-40e9-90d2-fe86d9b49719 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:49.178615 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d612929d-5a42-40e9-90d2-fe86d9b49719 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:49.179046 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d612929d-5a42-40e9-90d2-fe86d9b49719 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:49.198721 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-60155ca3-bb55-4a56-8505-0db4b11bd097 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:06:49.199238 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-60155ca3-bb55-4a56-8505-0db4b11bd097 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:06:49.199578 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-60155ca3-bb55-4a56-8505-0db4b11bd097 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:06:49.200367 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-60155ca3-bb55-4a56-8505-0db4b11bd097 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:06:49.200926 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-60155ca3-bb55-4a56-8505-0db4b11bd097 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:06:49.211066 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60155ca3-bb55-4a56-8505-0db4b11bd097 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:49.211912 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60155ca3-bb55-4a56-8505-0db4b11bd097 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:49.213018 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60155ca3-bb55-4a56-8505-0db4b11bd097 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:49.213565 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60155ca3-bb55-4a56-8505-0db4b11bd097 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:49.240205 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-60155ca3-bb55-4a56-8505-0db4b11bd097 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Getting quotas for project 934430ee5cd549c2ab1d0fa14ffcebd6. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:06:49.244486 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-60155ca3-bb55-4a56-8505-0db4b11bd097 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Getting quotas for user a4a80aace28d422fa6f86e9a5c13ecd7 and project 934430ee5cd549c2ab1d0fa14ffcebd6. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:06:49.256922 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-60155ca3-bb55-4a56-8505-0db4b11bd097 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:06:49.259584 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-60155ca3-bb55-4a56-8505-0db4b11bd097 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [instance: 2ded003d-59a9-4d0d-a1de-8a83def840d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:06:49.312073 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: ERROR oslo.messaging._drivers.impl_rabbit [None req-60155ca3-bb55-4a56-8505-0db4b11bd097 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [5d8a92ce-79d9-47c5-bc76-fa0c36660ce9] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 14:06:49.386018 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:06:49.386206 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:06:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Dec 15 14:06:50.331224 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [None req-60155ca3-bb55-4a56-8505-0db4b11bd097 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [5d8a92ce-79d9-47c5-bc76-fa0c36660ce9] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 44522. Dec 15 14:06:50.335999 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-60155ca3-bb55-4a56-8505-0db4b11bd097 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.762487 Dec 15 14:06:50.336688 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 234/465] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Dec 15 14:06:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 1764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:06:50.345565 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cb85d315-ec28-4c28-92d8-0605f33e1573 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:50.346620 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cb85d315-ec28-4c28-92d8-0605f33e1573 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:50.353492 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb85d315-ec28-4c28-92d8-0605f33e1573 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:50.353946 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb85d315-ec28-4c28-92d8-0605f33e1573 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:50.355088 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb85d315-ec28-4c28-92d8-0605f33e1573 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:50.355529 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb85d315-ec28-4c28-92d8-0605f33e1573 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:52.980818 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d612929d-5a42-40e9-90d2-fe86d9b49719 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 3.817418 Dec 15 14:06:52.981423 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 232/466] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:49 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 3819 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:52.986350 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-05fd2503-699f-4c29-8a35-49ee277b7954 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:52.987036 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-05fd2503-699f-4c29-8a35-49ee277b7954 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [instance: 2ded003d-59a9-4d0d-a1de-8a83def840d1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:52.992469 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cb85d315-ec28-4c28-92d8-0605f33e1573 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 2.654393 Dec 15 14:06:52.993648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 235/467] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:50 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 2656 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:52.995421 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05fd2503-699f-4c29-8a35-49ee277b7954 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:52.995870 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05fd2503-699f-4c29-8a35-49ee277b7954 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:52.996652 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05fd2503-699f-4c29-8a35-49ee277b7954 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:52.997084 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05fd2503-699f-4c29-8a35-49ee277b7954 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:53.059783 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-05fd2503-699f-4c29-8a35-49ee277b7954 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a80aace28d422fa6f86e9a5c13ecd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934430ee5cd549c2ab1d0fa14ffcebd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:06:53.067992 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-05fd2503-699f-4c29-8a35-49ee277b7954 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] 10.222.0.42 "GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1" status: 200 len: 1219 microversion: 2.1 time: 0.085436 Dec 15 14:06:53.068571 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 233/468] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:06:52 2021] GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:53.993732 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a95151db-df5a-4400-a500-7421bc1b6ecd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:53.994920 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a95151db-df5a-4400-a500-7421bc1b6ecd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:54.003385 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a95151db-df5a-4400-a500-7421bc1b6ecd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:54.003855 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a95151db-df5a-4400-a500-7421bc1b6ecd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:54.004371 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8b56b1c6-9304-45f2-b4d2-4e92838004a7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:54.005320 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a95151db-df5a-4400-a500-7421bc1b6ecd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:54.005914 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a95151db-df5a-4400-a500-7421bc1b6ecd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:54.006525 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8b56b1c6-9304-45f2-b4d2-4e92838004a7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:54.014996 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b56b1c6-9304-45f2-b4d2-4e92838004a7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:54.015738 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b56b1c6-9304-45f2-b4d2-4e92838004a7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:54.016755 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b56b1c6-9304-45f2-b4d2-4e92838004a7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:54.017383 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b56b1c6-9304-45f2-b4d2-4e92838004a7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:54.133968 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a95151db-df5a-4400-a500-7421bc1b6ecd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.144329 Dec 15 14:06:54.134406 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 236/469] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:53 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:54.139368 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d56a2cb5-9e9e-46dc-8f45-ba6bb7693c68 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:54.140044 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d56a2cb5-9e9e-46dc-8f45-ba6bb7693c68 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [instance: 2ded003d-59a9-4d0d-a1de-8a83def840d1] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:54.145993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8b56b1c6-9304-45f2-b4d2-4e92838004a7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.145201 Dec 15 14:06:54.146638 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 234/470] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:53 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:06:54.153473 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d56a2cb5-9e9e-46dc-8f45-ba6bb7693c68 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:54.153961 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d56a2cb5-9e9e-46dc-8f45-ba6bb7693c68 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:54.155166 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d56a2cb5-9e9e-46dc-8f45-ba6bb7693c68 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:54.155166 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d56a2cb5-9e9e-46dc-8f45-ba6bb7693c68 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:54.224388 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d56a2cb5-9e9e-46dc-8f45-ba6bb7693c68 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a80aace28d422fa6f86e9a5c13ecd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934430ee5cd549c2ab1d0fa14ffcebd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:06:54.233879 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d56a2cb5-9e9e-46dc-8f45-ba6bb7693c68 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] 10.222.0.42 "GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1" status: 200 len: 1273 microversion: 2.1 time: 0.097027 Dec 15 14:06:54.233879 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 237/471] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:06:54 2021] GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1 => generated 1273 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:55.146681 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9fa10008-56d9-4221-a446-89ed80ad077f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:55.147705 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9fa10008-56d9-4221-a446-89ed80ad077f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:55.157212 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9fa10008-56d9-4221-a446-89ed80ad077f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:55.157692 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9fa10008-56d9-4221-a446-89ed80ad077f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:55.158066 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8ecad910-a2ec-48ad-892a-95ff4cc23a3e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:55.158520 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9fa10008-56d9-4221-a446-89ed80ad077f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:55.158908 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9fa10008-56d9-4221-a446-89ed80ad077f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:55.159789 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8ecad910-a2ec-48ad-892a-95ff4cc23a3e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:55.168245 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ecad910-a2ec-48ad-892a-95ff4cc23a3e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:55.168697 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ecad910-a2ec-48ad-892a-95ff4cc23a3e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:55.170075 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ecad910-a2ec-48ad-892a-95ff4cc23a3e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:55.170686 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ecad910-a2ec-48ad-892a-95ff4cc23a3e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:55.288448 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9fa10008-56d9-4221-a446-89ed80ad077f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.145332 Dec 15 14:06:55.289842 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 235/472] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:55 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:55.295408 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d5290457-71a5-4827-a175-2e8a06ab5019 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:55.296230 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d5290457-71a5-4827-a175-2e8a06ab5019 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [instance: 2ded003d-59a9-4d0d-a1de-8a83def840d1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:55.303574 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5290457-71a5-4827-a175-2e8a06ab5019 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:55.304248 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5290457-71a5-4827-a175-2e8a06ab5019 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:55.305404 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5290457-71a5-4827-a175-2e8a06ab5019 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:55.306048 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5290457-71a5-4827-a175-2e8a06ab5019 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:55.321757 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8ecad910-a2ec-48ad-892a-95ff4cc23a3e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.167318 Dec 15 14:06:55.322748 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 238/473] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:55 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:06:55.328723 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-5b5a1590-5d3a-4eba-b7da-632245f666a4 req-1ec68ec6-fb48-44fb-b8f1-8700c98f6951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ded003d-59a9-4d0d-a1de-8a83def840d1", "tag": "726c627f-f6aa-4f9c-95c7-6498c75451a7"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:55.332867 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:06:55.332867 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:06:55.342005 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-5b5a1590-5d3a-4eba-b7da-632245f666a4 req-1ec68ec6-fb48-44fb-b8f1-8700c98f6951 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:55.342811 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-5b5a1590-5d3a-4eba-b7da-632245f666a4 req-1ec68ec6-fb48-44fb-b8f1-8700c98f6951 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:55.358001 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-5b5a1590-5d3a-4eba-b7da-632245f666a4 req-1ec68ec6-fb48-44fb-b8f1-8700c98f6951 service nova] Creating event network-changed:726c627f-f6aa-4f9c-95c7-6498c75451a7 for instance 2ded003d-59a9-4d0d-a1de-8a83def840d1 on hv-cinder-82182 Dec 15 14:06:55.364485 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-5b5a1590-5d3a-4eba-b7da-632245f666a4 req-1ec68ec6-fb48-44fb-b8f1-8700c98f6951 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039231 Dec 15 14:06:55.365544 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 239/474] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:06:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:06:55.372151 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8fb752c3-d519-4936-916a-338b9cc799e5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:55.372947 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8fb752c3-d519-4936-916a-338b9cc799e5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:55.381094 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8fb752c3-d519-4936-916a-338b9cc799e5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:55.381803 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8fb752c3-d519-4936-916a-338b9cc799e5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:55.382645 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8fb752c3-d519-4936-916a-338b9cc799e5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:55.383081 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8fb752c3-d519-4936-916a-338b9cc799e5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:55.521223 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-8fb752c3-d519-4936-916a-338b9cc799e5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lazy-loading 'services' on Instance uuid 55083faf-d97a-45a5-b660-307d716b4b1a {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:06:55.575654 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d5290457-71a5-4827-a175-2e8a06ab5019 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a80aace28d422fa6f86e9a5c13ecd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934430ee5cd549c2ab1d0fa14ffcebd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:06:55.583829 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d5290457-71a5-4827-a175-2e8a06ab5019 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] 10.222.0.42 "GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1" status: 200 len: 1315 microversion: 2.1 time: 0.292524 Dec 15 14:06:55.584444 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 236/475] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:06:55 2021] GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:55.658099 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8fb752c3-d519-4936-916a-338b9cc799e5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "DELETE /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a/os-volume_attachments/66f837d3-69ba-4669-98bc-fabb537d2071" status: 202 len: 0 microversion: 2.1 time: 0.290783 Dec 15 14:06:55.658698 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 240/476] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Dec 15 14:06:55 2021] DELETE /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a/os-volume_attachments/66f837d3-69ba-4669-98bc-fabb537d2071 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:56.300967 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2cf53351-1e84-4b14-8713-bce8d0042502 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:56.302440 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2cf53351-1e84-4b14-8713-bce8d0042502 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:56.317192 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cf53351-1e84-4b14-8713-bce8d0042502 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:56.317664 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cf53351-1e84-4b14-8713-bce8d0042502 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:56.318504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cf53351-1e84-4b14-8713-bce8d0042502 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:56.319289 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cf53351-1e84-4b14-8713-bce8d0042502 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:56.335377 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b9f06a15-ddbe-4114-b1cd-d4b2c6bc6ad0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:56.336735 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b9f06a15-ddbe-4114-b1cd-d4b2c6bc6ad0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:56.345788 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9f06a15-ddbe-4114-b1cd-d4b2c6bc6ad0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:56.346612 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9f06a15-ddbe-4114-b1cd-d4b2c6bc6ad0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:56.347644 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9f06a15-ddbe-4114-b1cd-d4b2c6bc6ad0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:56.348420 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9f06a15-ddbe-4114-b1cd-d4b2c6bc6ad0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:56.732988 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2cf53351-1e84-4b14-8713-bce8d0042502 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.435816 Dec 15 14:06:56.734581 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 237/477] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:56 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:56.742981 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1eec1613-5457-4407-a020-f2fb96f47402 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:56.743752 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b9f06a15-ddbe-4114-b1cd-d4b2c6bc6ad0 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.412585 Dec 15 14:06:56.744312 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1eec1613-5457-4407-a020-f2fb96f47402 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [instance: 2ded003d-59a9-4d0d-a1de-8a83def840d1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:56.744825 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 241/478] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:56 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:06:56.752241 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1eec1613-5457-4407-a020-f2fb96f47402 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:56.752927 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1eec1613-5457-4407-a020-f2fb96f47402 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:56.754003 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1eec1613-5457-4407-a020-f2fb96f47402 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:56.754782 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1eec1613-5457-4407-a020-f2fb96f47402 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:56.912088 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1eec1613-5457-4407-a020-f2fb96f47402 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a80aace28d422fa6f86e9a5c13ecd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934430ee5cd549c2ab1d0fa14ffcebd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:06:56.920039 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1eec1613-5457-4407-a020-f2fb96f47402 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] 10.222.0.42 "GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1" status: 200 len: 1315 microversion: 2.1 time: 0.183771 Dec 15 14:06:56.920629 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 238/479] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:06:56 2021] GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:57.751240 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-059a095f-cd8c-425b-a9b8-e6f558d464cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:57.752776 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-059a095f-cd8c-425b-a9b8-e6f558d464cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:57.759421 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4bc1240a-fa60-4c85-958d-364639fbcd78 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:57.760937 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4bc1240a-fa60-4c85-958d-364639fbcd78 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:57.766651 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-059a095f-cd8c-425b-a9b8-e6f558d464cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:57.766651 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-059a095f-cd8c-425b-a9b8-e6f558d464cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:57.766651 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-059a095f-cd8c-425b-a9b8-e6f558d464cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:57.766651 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-059a095f-cd8c-425b-a9b8-e6f558d464cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:57.768031 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4bc1240a-fa60-4c85-958d-364639fbcd78 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:57.768488 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4bc1240a-fa60-4c85-958d-364639fbcd78 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:57.769280 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4bc1240a-fa60-4c85-958d-364639fbcd78 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:57.769755 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4bc1240a-fa60-4c85-958d-364639fbcd78 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:58.008184 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-059a095f-cd8c-425b-a9b8-e6f558d464cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.263220 Dec 15 14:06:58.012252 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 242/480] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:57 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:06:58.014634 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5731b987-7b3d-4323-9020-548adc15d9eb tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:58.015342 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5731b987-7b3d-4323-9020-548adc15d9eb tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [instance: 2ded003d-59a9-4d0d-a1de-8a83def840d1] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:58.022552 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5731b987-7b3d-4323-9020-548adc15d9eb tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:58.023039 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5731b987-7b3d-4323-9020-548adc15d9eb tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:58.023873 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5731b987-7b3d-4323-9020-548adc15d9eb tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:58.024289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5731b987-7b3d-4323-9020-548adc15d9eb tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:58.027494 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4bc1240a-fa60-4c85-958d-364639fbcd78 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.274189 Dec 15 14:06:58.028417 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 239/481] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:57 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:58.163258 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5731b987-7b3d-4323-9020-548adc15d9eb tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a80aace28d422fa6f86e9a5c13ecd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934430ee5cd549c2ab1d0fa14ffcebd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:06:58.171148 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5731b987-7b3d-4323-9020-548adc15d9eb tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] 10.222.0.42 "GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1" status: 200 len: 1315 microversion: 2.1 time: 0.160544 Dec 15 14:06:58.171716 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 243/482] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:06:58 2021] GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:59.021226 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f889f9de-0c32-4f9a-a188-7e880ffc0ecc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:59.022266 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f889f9de-0c32-4f9a-a188-7e880ffc0ecc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:59.030471 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f889f9de-0c32-4f9a-a188-7e880ffc0ecc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:59.030921 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f889f9de-0c32-4f9a-a188-7e880ffc0ecc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:59.031709 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f889f9de-0c32-4f9a-a188-7e880ffc0ecc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:59.032148 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f889f9de-0c32-4f9a-a188-7e880ffc0ecc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:59.039806 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d868364a-3d25-42c1-91fd-bd6f90d6f664 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:59.040667 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d868364a-3d25-42c1-91fd-bd6f90d6f664 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:06:59.047476 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d868364a-3d25-42c1-91fd-bd6f90d6f664 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:59.047930 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d868364a-3d25-42c1-91fd-bd6f90d6f664 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:06:59.048729 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d868364a-3d25-42c1-91fd-bd6f90d6f664 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:06:59.049166 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d868364a-3d25-42c1-91fd-bd6f90d6f664 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:02.755259 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d868364a-3d25-42c1-91fd-bd6f90d6f664 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 3.719362 Dec 15 14:07:02.759408 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 244/483] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:06:59 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 3721 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:02.761820 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-552b1f8d-ccfe-4a89-bfba-4d14b3904318 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:02.762608 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-552b1f8d-ccfe-4a89-bfba-4d14b3904318 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [instance: 2ded003d-59a9-4d0d-a1de-8a83def840d1] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:02.766751 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f889f9de-0c32-4f9a-a188-7e880ffc0ecc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 3.749626 Dec 15 14:07:02.771051 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 240/484] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:06:59 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 3752 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:02.779746 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-552b1f8d-ccfe-4a89-bfba-4d14b3904318 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:02.780201 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-552b1f8d-ccfe-4a89-bfba-4d14b3904318 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:02.781014 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-552b1f8d-ccfe-4a89-bfba-4d14b3904318 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:02.781460 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-552b1f8d-ccfe-4a89-bfba-4d14b3904318 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:02.920434 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-552b1f8d-ccfe-4a89-bfba-4d14b3904318 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a80aace28d422fa6f86e9a5c13ecd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934430ee5cd549c2ab1d0fa14ffcebd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:02.928414 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-552b1f8d-ccfe-4a89-bfba-4d14b3904318 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] 10.222.0.42 "GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1" status: 200 len: 1315 microversion: 2.1 time: 0.170964 Dec 15 14:07:02.929053 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 245/485] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:02 2021] GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:03.767961 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9ecb191b-5791-497a-953c-21f9f1f87458 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:03.769016 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9ecb191b-5791-497a-953c-21f9f1f87458 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:03.777537 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ecb191b-5791-497a-953c-21f9f1f87458 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:03.778571 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ecb191b-5791-497a-953c-21f9f1f87458 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:03.779425 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ecb191b-5791-497a-953c-21f9f1f87458 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:03.779868 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ecb191b-5791-497a-953c-21f9f1f87458 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:03.783717 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ee19b335-a121-4da7-b97f-670fe38b531c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:03.784854 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ee19b335-a121-4da7-b97f-670fe38b531c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:03.792575 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee19b335-a121-4da7-b97f-670fe38b531c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:03.793025 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee19b335-a121-4da7-b97f-670fe38b531c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:03.794271 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee19b335-a121-4da7-b97f-670fe38b531c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:03.794550 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee19b335-a121-4da7-b97f-670fe38b531c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:04.062409 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9ecb191b-5791-497a-953c-21f9f1f87458 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.298318 Dec 15 14:07:04.063109 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 241/486] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:03 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:04.068050 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ac3ee8cb-9d89-4736-a123-6ae53ec596fd tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:04.068745 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ac3ee8cb-9d89-4736-a123-6ae53ec596fd tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [instance: 2ded003d-59a9-4d0d-a1de-8a83def840d1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:04.076086 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac3ee8cb-9d89-4736-a123-6ae53ec596fd tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:04.076550 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac3ee8cb-9d89-4736-a123-6ae53ec596fd tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:04.077356 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac3ee8cb-9d89-4736-a123-6ae53ec596fd tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:04.077842 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac3ee8cb-9d89-4736-a123-6ae53ec596fd tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:04.106967 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ee19b335-a121-4da7-b97f-670fe38b531c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.332384 Dec 15 14:07:04.107653 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 246/487] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:03 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:04.230375 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ac3ee8cb-9d89-4736-a123-6ae53ec596fd tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a80aace28d422fa6f86e9a5c13ecd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934430ee5cd549c2ab1d0fa14ffcebd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:04.238583 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ac3ee8cb-9d89-4736-a123-6ae53ec596fd tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] 10.222.0.42 "GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1" status: 200 len: 1315 microversion: 2.1 time: 0.174369 Dec 15 14:07:04.239149 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 242/488] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:04 2021] GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:05.075516 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1b7d13cc-a4e4-48ad-8c91-c7c2c19c5829 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:05.076605 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1b7d13cc-a4e4-48ad-8c91-c7c2c19c5829 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:05.083993 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b7d13cc-a4e4-48ad-8c91-c7c2c19c5829 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:05.084442 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b7d13cc-a4e4-48ad-8c91-c7c2c19c5829 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:05.085217 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b7d13cc-a4e4-48ad-8c91-c7c2c19c5829 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:05.085717 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b7d13cc-a4e4-48ad-8c91-c7c2c19c5829 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:05.120297 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1c8523d4-8ea0-4e2a-b85d-4335d11a89b5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:05.121205 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1c8523d4-8ea0-4e2a-b85d-4335d11a89b5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:05.128392 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c8523d4-8ea0-4e2a-b85d-4335d11a89b5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:05.128842 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c8523d4-8ea0-4e2a-b85d-4335d11a89b5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:05.129638 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c8523d4-8ea0-4e2a-b85d-4335d11a89b5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:05.130095 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c8523d4-8ea0-4e2a-b85d-4335d11a89b5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:09.473090 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1c8523d4-8ea0-4e2a-b85d-4335d11a89b5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 4.356326 Dec 15 14:07:09.473817 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 243/489] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:05 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 4358 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:09.479009 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-639d9c32-bdfa-4e1c-bdb2-3ad092ab8498 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:09.479732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-639d9c32-bdfa-4e1c-bdb2-3ad092ab8498 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [instance: 2ded003d-59a9-4d0d-a1de-8a83def840d1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:09.486724 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-639d9c32-bdfa-4e1c-bdb2-3ad092ab8498 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:09.487065 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-639d9c32-bdfa-4e1c-bdb2-3ad092ab8498 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:09.487842 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-639d9c32-bdfa-4e1c-bdb2-3ad092ab8498 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:09.488274 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-639d9c32-bdfa-4e1c-bdb2-3ad092ab8498 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:09.492993 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1b7d13cc-a4e4-48ad-8c91-c7c2c19c5829 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 4.421485 Dec 15 14:07:09.493980 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 247/490] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:05 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 4424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:09.499444 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3073c185-4c19-4fff-8f50-eca41aefcc50 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:09.500723 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3073c185-4c19-4fff-8f50-eca41aefcc50 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:09.508289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3073c185-4c19-4fff-8f50-eca41aefcc50 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:09.509122 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3073c185-4c19-4fff-8f50-eca41aefcc50 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:09.510227 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3073c185-4c19-4fff-8f50-eca41aefcc50 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:09.510994 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3073c185-4c19-4fff-8f50-eca41aefcc50 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:09.537787 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-3073c185-4c19-4fff-8f50-eca41aefcc50 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lazy-loading 'flavor' on Instance uuid bfccdaf0-2b79-4ace-a816-8c76eba7f48b {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:07:09.649655 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-639d9c32-bdfa-4e1c-bdb2-3ad092ab8498 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a80aace28d422fa6f86e9a5c13ecd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934430ee5cd549c2ab1d0fa14ffcebd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:09.666695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-639d9c32-bdfa-4e1c-bdb2-3ad092ab8498 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] 10.222.0.42 "GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1" status: 200 len: 1315 microversion: 2.1 time: 0.191543 Dec 15 14:07:09.667294 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 244/491] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:09 2021] GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:09.728012 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3073c185-4c19-4fff-8f50-eca41aefcc50 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "POST /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b/action" status: 200 len: 32 microversion: 2.1 time: 0.232376 Dec 15 14:07:09.728906 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 248/492] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:09 2021] POST /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b/action => generated 32 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:07:09.742729 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0bb676dd-6202-4028-8f79-914a60325df2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:09.743627 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0bb676dd-6202-4028-8f79-914a60325df2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:09.752258 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0bb676dd-6202-4028-8f79-914a60325df2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:09.752872 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0bb676dd-6202-4028-8f79-914a60325df2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:09.753759 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0bb676dd-6202-4028-8f79-914a60325df2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:09.754517 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0bb676dd-6202-4028-8f79-914a60325df2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:09.971858 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0bb676dd-6202-4028-8f79-914a60325df2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:09.980656 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0bb676dd-6202-4028-8f79-914a60325df2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1567 microversion: 2.1 time: 0.244061 Dec 15 14:07:09.981186 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 245/493] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:09 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:10.488099 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8af12f5b-ca70-4ef8-8cb4-4ff1c0f3dfd2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:10.489172 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8af12f5b-ca70-4ef8-8cb4-4ff1c0f3dfd2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:10.496470 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8af12f5b-ca70-4ef8-8cb4-4ff1c0f3dfd2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:10.497413 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8af12f5b-ca70-4ef8-8cb4-4ff1c0f3dfd2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:10.500046 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8af12f5b-ca70-4ef8-8cb4-4ff1c0f3dfd2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:10.500046 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8af12f5b-ca70-4ef8-8cb4-4ff1c0f3dfd2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:10.505831 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-34dd7065-9b41-47b4-9085-020b70409636 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:10.506826 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-34dd7065-9b41-47b4-9085-020b70409636 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:10.514083 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34dd7065-9b41-47b4-9085-020b70409636 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:10.514083 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34dd7065-9b41-47b4-9085-020b70409636 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:10.519347 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34dd7065-9b41-47b4-9085-020b70409636 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:10.519641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34dd7065-9b41-47b4-9085-020b70409636 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:10.650467 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-34dd7065-9b41-47b4-9085-020b70409636 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.149515 Dec 15 14:07:10.651092 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 246/494] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:10 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:07:10.670380 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8af12f5b-ca70-4ef8-8cb4-4ff1c0f3dfd2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.186365 Dec 15 14:07:10.671152 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 249/495] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:10 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:10.687369 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a37615ea-e2c4-41e4-aa17-45bfcd064aae tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:10.688153 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a37615ea-e2c4-41e4-aa17-45bfcd064aae tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [instance: 2ded003d-59a9-4d0d-a1de-8a83def840d1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:10.694858 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a37615ea-e2c4-41e4-aa17-45bfcd064aae tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:10.695303 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a37615ea-e2c4-41e4-aa17-45bfcd064aae tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:10.696089 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a37615ea-e2c4-41e4-aa17-45bfcd064aae tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:10.696523 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a37615ea-e2c4-41e4-aa17-45bfcd064aae tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:10.843141 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a37615ea-e2c4-41e4-aa17-45bfcd064aae tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a80aace28d422fa6f86e9a5c13ecd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934430ee5cd549c2ab1d0fa14ffcebd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:10.854561 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a37615ea-e2c4-41e4-aa17-45bfcd064aae tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] 10.222.0.42 "GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1" status: 200 len: 1315 microversion: 2.1 time: 0.172508 Dec 15 14:07:10.855270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 247/496] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:10 2021] GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:10.998265 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2f0dc390-7c58-45e9-affe-266b5bd64aea tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:10.999059 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2f0dc390-7c58-45e9-affe-266b5bd64aea tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:11.006292 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f0dc390-7c58-45e9-affe-266b5bd64aea tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:11.006732 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f0dc390-7c58-45e9-affe-266b5bd64aea tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:11.007506 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f0dc390-7c58-45e9-affe-266b5bd64aea tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:11.007921 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f0dc390-7c58-45e9-affe-266b5bd64aea tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:11.158083 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2f0dc390-7c58-45e9-affe-266b5bd64aea tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:11.166220 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2f0dc390-7c58-45e9-affe-266b5bd64aea tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1567 microversion: 2.1 time: 0.171865 Dec 15 14:07:11.166679 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 250/497] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:10 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:11.663602 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4087f8aa-22d0-491b-8ebe-79a60e51262a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:11.664591 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4087f8aa-22d0-491b-8ebe-79a60e51262a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:11.671722 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-91c12656-3d20-4aab-b7e2-f4cd99329c37 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:11.672295 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4087f8aa-22d0-491b-8ebe-79a60e51262a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:11.672396 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-91c12656-3d20-4aab-b7e2-f4cd99329c37 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:11.672496 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4087f8aa-22d0-491b-8ebe-79a60e51262a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:11.673115 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4087f8aa-22d0-491b-8ebe-79a60e51262a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:11.673547 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4087f8aa-22d0-491b-8ebe-79a60e51262a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:11.678558 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-91c12656-3d20-4aab-b7e2-f4cd99329c37 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:11.679013 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-91c12656-3d20-4aab-b7e2-f4cd99329c37 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:11.679802 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-91c12656-3d20-4aab-b7e2-f4cd99329c37 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:11.680243 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-91c12656-3d20-4aab-b7e2-f4cd99329c37 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:11.705996 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-91c12656-3d20-4aab-b7e2-f4cd99329c37 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:07:11.756854 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4087f8aa-22d0-491b-8ebe-79a60e51262a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.097616 Dec 15 14:07:11.761389 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 248/498] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:11 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:11.765168 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cf8e3355-8717-4d72-b9f0-666f60720cb9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:11.766032 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cf8e3355-8717-4d72-b9f0-666f60720cb9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:11.774556 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf8e3355-8717-4d72-b9f0-666f60720cb9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:11.775293 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf8e3355-8717-4d72-b9f0-666f60720cb9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:11.776288 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf8e3355-8717-4d72-b9f0-666f60720cb9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:11.777719 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf8e3355-8717-4d72-b9f0-666f60720cb9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:11.800788 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-91c12656-3d20-4aab-b7e2-f4cd99329c37 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "DELETE /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 204 len: 0 microversion: 2.1 time: 0.133235 Dec 15 14:07:11.801622 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 251/499] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:07:11 2021] DELETE /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 14:07:11.811333 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-771abb2a-5a1a-435a-a1b7-83d5f429dd08 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:11.812268 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-771abb2a-5a1a-435a-a1b7-83d5f429dd08 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:11.819180 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-771abb2a-5a1a-435a-a1b7-83d5f429dd08 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:11.819838 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-771abb2a-5a1a-435a-a1b7-83d5f429dd08 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:11.821921 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-771abb2a-5a1a-435a-a1b7-83d5f429dd08 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:11.822369 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-771abb2a-5a1a-435a-a1b7-83d5f429dd08 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:11.975731 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-771abb2a-5a1a-435a-a1b7-83d5f429dd08 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:11.985793 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-771abb2a-5a1a-435a-a1b7-83d5f429dd08 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1514 microversion: 2.1 time: 0.179201 Dec 15 14:07:11.986470 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 252/500] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:11 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:12.003064 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d9f1c2de-1776-409b-8cdd-c7d85be71d08 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:12.003945 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d9f1c2de-1776-409b-8cdd-c7d85be71d08 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [instance: 2ded003d-59a9-4d0d-a1de-8a83def840d1] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:12.012078 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9f1c2de-1776-409b-8cdd-c7d85be71d08 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:12.013016 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9f1c2de-1776-409b-8cdd-c7d85be71d08 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:12.014406 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9f1c2de-1776-409b-8cdd-c7d85be71d08 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:12.015094 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9f1c2de-1776-409b-8cdd-c7d85be71d08 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:12.029833 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cf8e3355-8717-4d72-b9f0-666f60720cb9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.269491 Dec 15 14:07:12.031255 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 249/501] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:11 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:12.036651 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-e33a6262-67a5-4fde-94d6-50382777bb5f req-eda86e05-f3e2-4ee4-9f8a-5265e0ac46a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ded003d-59a9-4d0d-a1de-8a83def840d1", "name": "network-vif-plugged", "status": "completed", "tag": "726c627f-f6aa-4f9c-95c7-6498c75451a7"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:12.038681 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:07:12.038681 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:07:12.047740 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-e33a6262-67a5-4fde-94d6-50382777bb5f req-eda86e05-f3e2-4ee4-9f8a-5265e0ac46a6 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:12.048461 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-e33a6262-67a5-4fde-94d6-50382777bb5f req-eda86e05-f3e2-4ee4-9f8a-5265e0ac46a6 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:12.073806 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-e33a6262-67a5-4fde-94d6-50382777bb5f req-eda86e05-f3e2-4ee4-9f8a-5265e0ac46a6 service nova] Creating event network-vif-plugged:726c627f-f6aa-4f9c-95c7-6498c75451a7 for instance 2ded003d-59a9-4d0d-a1de-8a83def840d1 on hv-cinder-82182 Dec 15 14:07:12.080447 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-e33a6262-67a5-4fde-94d6-50382777bb5f req-eda86e05-f3e2-4ee4-9f8a-5265e0ac46a6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047557 Dec 15 14:07:12.081240 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 250/502] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:07:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:07:12.168989 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d9f1c2de-1776-409b-8cdd-c7d85be71d08 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a80aace28d422fa6f86e9a5c13ecd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934430ee5cd549c2ab1d0fa14ffcebd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:12.177041 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d9f1c2de-1776-409b-8cdd-c7d85be71d08 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] 10.222.0.42 "GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1" status: 200 len: 1315 microversion: 2.1 time: 0.178045 Dec 15 14:07:12.179085 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 253/503] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:11 2021] GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:12.185851 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-42da46ad-18c0-45c5-aa12-48d12da3d267 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:12.186973 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-42da46ad-18c0-45c5-aa12-48d12da3d267 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:12.193802 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42da46ad-18c0-45c5-aa12-48d12da3d267 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:12.194366 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42da46ad-18c0-45c5-aa12-48d12da3d267 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:12.195225 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42da46ad-18c0-45c5-aa12-48d12da3d267 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:12.195739 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42da46ad-18c0-45c5-aa12-48d12da3d267 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:12.414100 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-42da46ad-18c0-45c5-aa12-48d12da3d267 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:12.423871 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-42da46ad-18c0-45c5-aa12-48d12da3d267 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1567 microversion: 2.1 time: 0.243292 Dec 15 14:07:12.424476 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 251/504] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:12 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:07:12.771898 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e585af4b-268e-4be4-ad26-556edb16b30d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:12.772871 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e585af4b-268e-4be4-ad26-556edb16b30d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:12.779648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e585af4b-268e-4be4-ad26-556edb16b30d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:12.780906 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e585af4b-268e-4be4-ad26-556edb16b30d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:12.782109 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e585af4b-268e-4be4-ad26-556edb16b30d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:12.782475 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e585af4b-268e-4be4-ad26-556edb16b30d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:12.956335 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e585af4b-268e-4be4-ad26-556edb16b30d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.187976 Dec 15 14:07:12.956982 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 254/505] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:12 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:13.005310 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e2d16efc-a064-47b9-a8e6-2aba878e2374 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:13.006088 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e2d16efc-a064-47b9-a8e6-2aba878e2374 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:13.012698 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2d16efc-a064-47b9-a8e6-2aba878e2374 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:13.013255 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2d16efc-a064-47b9-a8e6-2aba878e2374 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:13.014057 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2d16efc-a064-47b9-a8e6-2aba878e2374 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:13.014587 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2d16efc-a064-47b9-a8e6-2aba878e2374 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:13.042365 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7a7a66ed-8a0f-4b1f-a523-6d3ae27e1e48 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:13.043359 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7a7a66ed-8a0f-4b1f-a523-6d3ae27e1e48 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:13.050640 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a7a66ed-8a0f-4b1f-a523-6d3ae27e1e48 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:13.051081 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a7a66ed-8a0f-4b1f-a523-6d3ae27e1e48 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:13.051980 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a7a66ed-8a0f-4b1f-a523-6d3ae27e1e48 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:13.052413 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a7a66ed-8a0f-4b1f-a523-6d3ae27e1e48 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:13.167684 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e2d16efc-a064-47b9-a8e6-2aba878e2374 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:13.176057 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e2d16efc-a064-47b9-a8e6-2aba878e2374 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1514 microversion: 2.1 time: 0.175233 Dec 15 14:07:13.176882 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 252/506] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:12 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:13.194299 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-191616ae-1177-454d-8133-e0d642c0d0ed tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:13.194925 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-191616ae-1177-454d-8133-e0d642c0d0ed tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [instance: 2ded003d-59a9-4d0d-a1de-8a83def840d1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:13.200985 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-191616ae-1177-454d-8133-e0d642c0d0ed tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:13.202814 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-191616ae-1177-454d-8133-e0d642c0d0ed tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:13.203731 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-191616ae-1177-454d-8133-e0d642c0d0ed tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:13.204173 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-191616ae-1177-454d-8133-e0d642c0d0ed tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:13.238562 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7a7a66ed-8a0f-4b1f-a523-6d3ae27e1e48 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.199140 Dec 15 14:07:13.240520 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 255/507] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:13 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:13.358340 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-191616ae-1177-454d-8133-e0d642c0d0ed tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a80aace28d422fa6f86e9a5c13ecd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934430ee5cd549c2ab1d0fa14ffcebd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:13.365746 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-191616ae-1177-454d-8133-e0d642c0d0ed tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] 10.222.0.42 "GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1" status: 200 len: 1315 microversion: 2.1 time: 0.174976 Dec 15 14:07:13.366315 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 253/508] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:13 2021] GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:13.442659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6f644636-52dc-46c6-a744-1cc6aef0101b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:13.443369 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6f644636-52dc-46c6-a744-1cc6aef0101b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:13.450838 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f644636-52dc-46c6-a744-1cc6aef0101b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:13.451307 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f644636-52dc-46c6-a744-1cc6aef0101b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:13.453473 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f644636-52dc-46c6-a744-1cc6aef0101b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:13.454186 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f644636-52dc-46c6-a744-1cc6aef0101b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:13.621442 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6f644636-52dc-46c6-a744-1cc6aef0101b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:13.630377 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6f644636-52dc-46c6-a744-1cc6aef0101b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1567 microversion: 2.1 time: 0.192678 Dec 15 14:07:13.631277 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 256/509] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:13 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:13.969237 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8761a1c5-d199-4659-9ba1-3ab60f0b22c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:13.970664 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8761a1c5-d199-4659-9ba1-3ab60f0b22c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:13.981884 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8761a1c5-d199-4659-9ba1-3ab60f0b22c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:13.981884 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8761a1c5-d199-4659-9ba1-3ab60f0b22c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:13.981884 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8761a1c5-d199-4659-9ba1-3ab60f0b22c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:13.981884 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8761a1c5-d199-4659-9ba1-3ab60f0b22c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:14.118563 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8761a1c5-d199-4659-9ba1-3ab60f0b22c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.153781 Dec 15 14:07:14.122598 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 254/510] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:13 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:14.194158 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-da1abbe5-6067-448a-9a14-3d7e828d7542 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:14.194644 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-da1abbe5-6067-448a-9a14-3d7e828d7542 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:14.203180 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da1abbe5-6067-448a-9a14-3d7e828d7542 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:14.203723 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da1abbe5-6067-448a-9a14-3d7e828d7542 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:14.204670 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da1abbe5-6067-448a-9a14-3d7e828d7542 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:14.205141 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da1abbe5-6067-448a-9a14-3d7e828d7542 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:14.252170 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-047198a3-9596-4b08-9b66-27abad895c6c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:14.253301 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-047198a3-9596-4b08-9b66-27abad895c6c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:14.261737 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-047198a3-9596-4b08-9b66-27abad895c6c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:14.262210 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-047198a3-9596-4b08-9b66-27abad895c6c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:14.263031 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-047198a3-9596-4b08-9b66-27abad895c6c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:14.263465 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-047198a3-9596-4b08-9b66-27abad895c6c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:14.385519 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-da1abbe5-6067-448a-9a14-3d7e828d7542 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:14.387374 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-047198a3-9596-4b08-9b66-27abad895c6c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.134453 Dec 15 14:07:14.388250 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 255/511] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:14 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:14.395482 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-da1abbe5-6067-448a-9a14-3d7e828d7542 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1514 microversion: 2.1 time: 0.204907 Dec 15 14:07:14.396387 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 257/512] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:14 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:14.407763 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5528c7e3-85da-40b0-b5e0-af3f1cd79307 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:14.408706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5528c7e3-85da-40b0-b5e0-af3f1cd79307 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [instance: 2ded003d-59a9-4d0d-a1de-8a83def840d1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:14.427699 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5528c7e3-85da-40b0-b5e0-af3f1cd79307 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:14.428263 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5528c7e3-85da-40b0-b5e0-af3f1cd79307 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:14.429193 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5528c7e3-85da-40b0-b5e0-af3f1cd79307 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:14.429728 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5528c7e3-85da-40b0-b5e0-af3f1cd79307 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:14.579103 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5528c7e3-85da-40b0-b5e0-af3f1cd79307 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a80aace28d422fa6f86e9a5c13ecd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934430ee5cd549c2ab1d0fa14ffcebd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:14.587409 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5528c7e3-85da-40b0-b5e0-af3f1cd79307 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] 10.222.0.42 "GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1" status: 200 len: 1465 microversion: 2.1 time: 0.197293 Dec 15 14:07:14.588061 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 256/513] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:14 2021] GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1 => generated 1465 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:14.641709 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-371b9ea0-b475-4758-b2e0-d0cb0222aa7f tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:14.642250 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-371b9ea0-b475-4758-b2e0-d0cb0222aa7f tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [instance: 2ded003d-59a9-4d0d-a1de-8a83def840d1] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:14.647283 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-24602973-ddc7-4ca0-9771-60ad59bdd8ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:14.648198 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-24602973-ddc7-4ca0-9771-60ad59bdd8ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:14.649217 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-371b9ea0-b475-4758-b2e0-d0cb0222aa7f tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:14.650331 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-371b9ea0-b475-4758-b2e0-d0cb0222aa7f tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:14.651526 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-371b9ea0-b475-4758-b2e0-d0cb0222aa7f tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:14.652398 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-371b9ea0-b475-4758-b2e0-d0cb0222aa7f tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:14.660316 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24602973-ddc7-4ca0-9771-60ad59bdd8ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:14.661007 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24602973-ddc7-4ca0-9771-60ad59bdd8ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:14.661326 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24602973-ddc7-4ca0-9771-60ad59bdd8ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:14.661787 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24602973-ddc7-4ca0-9771-60ad59bdd8ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:14.714225 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-371b9ea0-b475-4758-b2e0-d0cb0222aa7f tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [instance: 2ded003d-59a9-4d0d-a1de-8a83def840d1] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:07:14.817167 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-371b9ea0-b475-4758-b2e0-d0cb0222aa7f tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1" status: 204 len: 0 microversion: 2.1 time: 0.178011 Dec 15 14:07:14.819875 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 258/514] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:07:14 2021] DELETE /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:07:14.830319 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a80150b8-6526-4e1a-81a6-a3f856da2d56 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:14.831099 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a80150b8-6526-4e1a-81a6-a3f856da2d56 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [instance: 2ded003d-59a9-4d0d-a1de-8a83def840d1] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:14.838234 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a80150b8-6526-4e1a-81a6-a3f856da2d56 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:14.838742 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a80150b8-6526-4e1a-81a6-a3f856da2d56 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:14.839631 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a80150b8-6526-4e1a-81a6-a3f856da2d56 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:14.840129 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a80150b8-6526-4e1a-81a6-a3f856da2d56 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:14.864374 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-24602973-ddc7-4ca0-9771-60ad59bdd8ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:14.873917 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-24602973-ddc7-4ca0-9771-60ad59bdd8ee tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1567 microversion: 2.1 time: 0.230778 Dec 15 14:07:14.875969 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 257/515] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:14 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:07:14.990102 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a80150b8-6526-4e1a-81a6-a3f856da2d56 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a80aace28d422fa6f86e9a5c13ecd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934430ee5cd549c2ab1d0fa14ffcebd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:14.999729 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a80150b8-6526-4e1a-81a6-a3f856da2d56 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] 10.222.0.42 "GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1" status: 200 len: 1471 microversion: 2.1 time: 0.174764 Dec 15 14:07:15.000490 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 259/516] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:14 2021] GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1 => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:15.131792 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5ab0ff90-f980-42bc-a5e9-24f3674711f8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:15.133918 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5ab0ff90-f980-42bc-a5e9-24f3674711f8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:15.141840 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5ab0ff90-f980-42bc-a5e9-24f3674711f8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:15.142628 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5ab0ff90-f980-42bc-a5e9-24f3674711f8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:15.143920 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5ab0ff90-f980-42bc-a5e9-24f3674711f8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:15.144772 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5ab0ff90-f980-42bc-a5e9-24f3674711f8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:15.255782 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5ab0ff90-f980-42bc-a5e9-24f3674711f8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.128661 Dec 15 14:07:15.256623 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 258/517] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:15 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:15.399744 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ffe17188-e127-4585-9b67-58e52d367bce tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:15.400704 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ffe17188-e127-4585-9b67-58e52d367bce tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:15.408401 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffe17188-e127-4585-9b67-58e52d367bce tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:15.408819 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffe17188-e127-4585-9b67-58e52d367bce tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:15.409672 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffe17188-e127-4585-9b67-58e52d367bce tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:15.410108 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffe17188-e127-4585-9b67-58e52d367bce tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:15.413425 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-42084dc0-f2f6-4990-a8ca-f88693867ae4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:15.415330 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-42084dc0-f2f6-4990-a8ca-f88693867ae4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:15.422221 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42084dc0-f2f6-4990-a8ca-f88693867ae4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:15.422663 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42084dc0-f2f6-4990-a8ca-f88693867ae4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:15.423482 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42084dc0-f2f6-4990-a8ca-f88693867ae4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:15.423912 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42084dc0-f2f6-4990-a8ca-f88693867ae4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:15.519148 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ffe17188-e127-4585-9b67-58e52d367bce tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.122867 Dec 15 14:07:15.519713 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 260/518] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:15 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:15.754571 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-42084dc0-f2f6-4990-a8ca-f88693867ae4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:15.762892 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-42084dc0-f2f6-4990-a8ca-f88693867ae4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1514 microversion: 2.1 time: 0.353685 Dec 15 14:07:15.763474 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 259/519] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:15 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1514 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:15.894503 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-61f09706-0e1a-49e8-aa0f-4268b1ed7402 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:15.896256 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-61f09706-0e1a-49e8-aa0f-4268b1ed7402 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:15.912032 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61f09706-0e1a-49e8-aa0f-4268b1ed7402 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:15.913388 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61f09706-0e1a-49e8-aa0f-4268b1ed7402 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:15.915963 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61f09706-0e1a-49e8-aa0f-4268b1ed7402 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:15.916563 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61f09706-0e1a-49e8-aa0f-4268b1ed7402 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:16.018819 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cc3aff5c-9993-48b4-8cf4-5e85d5f9fae8 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:16.021067 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cc3aff5c-9993-48b4-8cf4-5e85d5f9fae8 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [instance: 2ded003d-59a9-4d0d-a1de-8a83def840d1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:16.030595 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cc3aff5c-9993-48b4-8cf4-5e85d5f9fae8 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:16.031384 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cc3aff5c-9993-48b4-8cf4-5e85d5f9fae8 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:16.032440 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cc3aff5c-9993-48b4-8cf4-5e85d5f9fae8 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:16.033032 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cc3aff5c-9993-48b4-8cf4-5e85d5f9fae8 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:16.387673 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-61f09706-0e1a-49e8-aa0f-4268b1ed7402 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:16.396608 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-61f09706-0e1a-49e8-aa0f-4268b1ed7402 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1567 microversion: 2.1 time: 0.508076 Dec 15 14:07:16.397334 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 261/520] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:15 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1567 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:16.406815 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cb3166fc-3943-43f8-9c5d-cb33e63f985b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:16.406815 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cb3166fc-3943-43f8-9c5d-cb33e63f985b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:16.412121 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb3166fc-3943-43f8-9c5d-cb33e63f985b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:16.412776 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb3166fc-3943-43f8-9c5d-cb33e63f985b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:16.414449 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb3166fc-3943-43f8-9c5d-cb33e63f985b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:16.415050 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb3166fc-3943-43f8-9c5d-cb33e63f985b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:16.526659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cb3166fc-3943-43f8-9c5d-cb33e63f985b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.127206 Dec 15 14:07:16.527326 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 262/521] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:16 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:16.533447 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-956ab839-e6c0-4c18-baa8-03cb795d2609 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:16.534802 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-956ab839-e6c0-4c18-baa8-03cb795d2609 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:16.543922 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-956ab839-e6c0-4c18-baa8-03cb795d2609 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:16.544404 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-956ab839-e6c0-4c18-baa8-03cb795d2609 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:16.545208 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-956ab839-e6c0-4c18-baa8-03cb795d2609 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:16.545770 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-956ab839-e6c0-4c18-baa8-03cb795d2609 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:16.555969 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cc3aff5c-9993-48b4-8cf4-5e85d5f9fae8 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a80aace28d422fa6f86e9a5c13ecd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934430ee5cd549c2ab1d0fa14ffcebd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:16.564590 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cc3aff5c-9993-48b4-8cf4-5e85d5f9fae8 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] 10.222.0.42 "GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1" status: 200 len: 1471 microversion: 2.1 time: 0.550726 Dec 15 14:07:16.566320 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 260/522] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:16 2021] GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1 => generated 1471 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:07:16.579417 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-0610e4b7-ece6-45a5-bf59-14fe45959606 req-a5a3e5de-a7d2-4ffb-afbf-d32e19e88f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55083faf-d97a-45a5-b660-307d716b4b1a", "name": "network-vif-deleted", "tag": "4d1a6ff2-6e12-4ab6-b6f0-baa00971cc60"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:16.580991 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:07:16.580991 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:07:16.588390 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-0610e4b7-ece6-45a5-bf59-14fe45959606 req-a5a3e5de-a7d2-4ffb-afbf-d32e19e88f0d service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:16.589034 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-0610e4b7-ece6-45a5-bf59-14fe45959606 req-a5a3e5de-a7d2-4ffb-afbf-d32e19e88f0d service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:16.604084 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-0610e4b7-ece6-45a5-bf59-14fe45959606 req-a5a3e5de-a7d2-4ffb-afbf-d32e19e88f0d service nova] Creating event network-vif-deleted:4d1a6ff2-6e12-4ab6-b6f0-baa00971cc60 for instance 55083faf-d97a-45a5-b660-307d716b4b1a on hv-cinder-82182 Dec 15 14:07:16.609442 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-0610e4b7-ece6-45a5-bf59-14fe45959606 req-a5a3e5de-a7d2-4ffb-afbf-d32e19e88f0d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042186 Dec 15 14:07:16.610701 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 261/523] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:07:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:07:16.740786 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-956ab839-e6c0-4c18-baa8-03cb795d2609 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.211781 Dec 15 14:07:16.741822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 263/524] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:16 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:16.787421 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9122ed23-8d39-4fff-a23e-9ce561a91993 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:16.788127 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9122ed23-8d39-4fff-a23e-9ce561a91993 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:16.799570 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9122ed23-8d39-4fff-a23e-9ce561a91993 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:16.800029 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9122ed23-8d39-4fff-a23e-9ce561a91993 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:16.800878 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9122ed23-8d39-4fff-a23e-9ce561a91993 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:16.801324 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9122ed23-8d39-4fff-a23e-9ce561a91993 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:16.852151 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9122ed23-8d39-4fff-a23e-9ce561a91993 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:16.852506 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9122ed23-8d39-4fff-a23e-9ce561a91993 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:16.852957 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-9122ed23-8d39-4fff-a23e-9ce561a91993 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lazy-loading 'fault' on Instance uuid 55083faf-d97a-45a5-b660-307d716b4b1a {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:07:16.926832 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9122ed23-8d39-4fff-a23e-9ce561a91993 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:16.936103 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9122ed23-8d39-4fff-a23e-9ce561a91993 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 200 len: 1309 microversion: 2.1 time: 0.159053 Dec 15 14:07:16.937082 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 262/525] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:16 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 1309 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:17.415112 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7b51096c-5b14-4bac-a829-33578917741c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:17.416066 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7b51096c-5b14-4bac-a829-33578917741c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:17.427023 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b51096c-5b14-4bac-a829-33578917741c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:17.427664 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b51096c-5b14-4bac-a829-33578917741c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:17.429725 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b51096c-5b14-4bac-a829-33578917741c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:17.430384 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b51096c-5b14-4bac-a829-33578917741c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:17.539571 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7e53460e-eb48-445e-ac99-2e1363b089d1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:17.540513 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7e53460e-eb48-445e-ac99-2e1363b089d1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:17.549796 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e53460e-eb48-445e-ac99-2e1363b089d1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:17.550323 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e53460e-eb48-445e-ac99-2e1363b089d1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:17.551128 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e53460e-eb48-445e-ac99-2e1363b089d1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:17.562470 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e53460e-eb48-445e-ac99-2e1363b089d1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:17.664340 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7e53460e-eb48-445e-ac99-2e1363b089d1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.128354 Dec 15 14:07:17.666695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 263/526] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:17 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:07:17.675037 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8176b515-b3cb-4b7a-b609-2dfe47d7a387 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:17.677435 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8176b515-b3cb-4b7a-b609-2dfe47d7a387 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [instance: 2ded003d-59a9-4d0d-a1de-8a83def840d1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:17.693311 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8176b515-b3cb-4b7a-b609-2dfe47d7a387 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:17.694185 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8176b515-b3cb-4b7a-b609-2dfe47d7a387 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:17.695356 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8176b515-b3cb-4b7a-b609-2dfe47d7a387 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:17.695975 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8176b515-b3cb-4b7a-b609-2dfe47d7a387 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:18.487695 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7b51096c-5b14-4bac-a829-33578917741c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:18.498346 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7b51096c-5b14-4bac-a829-33578917741c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1567 microversion: 2.1 time: 1.087326 Dec 15 14:07:18.511294 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 264/527] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:17 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1567 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:07:18.522340 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-eb8a8d61-15e0-4f2c-98d5-7f95c3e55670 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:18.523766 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-eb8a8d61-15e0-4f2c-98d5-7f95c3e55670 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:18.535784 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb8a8d61-15e0-4f2c-98d5-7f95c3e55670 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:18.536635 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb8a8d61-15e0-4f2c-98d5-7f95c3e55670 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:18.538441 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb8a8d61-15e0-4f2c-98d5-7f95c3e55670 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:18.539195 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb8a8d61-15e0-4f2c-98d5-7f95c3e55670 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:18.644948 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-eb8a8d61-15e0-4f2c-98d5-7f95c3e55670 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.131376 Dec 15 14:07:18.646138 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 265/528] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:18 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:18.655345 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ab4c504f-265e-489f-9b61-0f5d76314a74 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:18.656662 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ab4c504f-265e-489f-9b61-0f5d76314a74 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 55083faf-d97a-45a5-b660-307d716b4b1a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:18.666143 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab4c504f-265e-489f-9b61-0f5d76314a74 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:18.667041 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab4c504f-265e-489f-9b61-0f5d76314a74 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:18.668506 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab4c504f-265e-489f-9b61-0f5d76314a74 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:18.669334 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab4c504f-265e-489f-9b61-0f5d76314a74 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:18.712745 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-ab4c504f-265e-489f-9b61-0f5d76314a74 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] HTTP exception thrown: Instance 55083faf-d97a-45a5-b660-307d716b4b1a could not be found. Dec 15 14:07:18.713935 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ab4c504f-265e-489f-9b61-0f5d76314a74 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Returning 404 to user: Instance 55083faf-d97a-45a5-b660-307d716b4b1a could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:07:18.715620 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ab4c504f-265e-489f-9b61-0f5d76314a74 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a" status: 404 len: 111 microversion: 2.1 time: 0.067431 Dec 15 14:07:18.716509 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 266/529] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:18 2021] GET /compute/v2.1/servers/55083faf-d97a-45a5-b660-307d716b4b1a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:07:18.725927 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e5f4520a-2f7b-423d-959b-1a5c0af491c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:18.727686 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e5f4520a-2f7b-423d-959b-1a5c0af491c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:18.748831 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5f4520a-2f7b-423d-959b-1a5c0af491c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:18.750420 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5f4520a-2f7b-423d-959b-1a5c0af491c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:18.752622 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5f4520a-2f7b-423d-959b-1a5c0af491c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:18.754831 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5f4520a-2f7b-423d-959b-1a5c0af491c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:18.872037 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8176b515-b3cb-4b7a-b609-2dfe47d7a387 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a80aace28d422fa6f86e9a5c13ecd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934430ee5cd549c2ab1d0fa14ffcebd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:18.886385 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8176b515-b3cb-4b7a-b609-2dfe47d7a387 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] 10.222.0.42 "GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1" status: 200 len: 1471 microversion: 2.1 time: 1.216334 Dec 15 14:07:18.892266 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e5f4520a-2f7b-423d-959b-1a5c0af491c8 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.173678 Dec 15 14:07:18.892571 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 264/530] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:17 2021] GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1 => generated 1471 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:18.893189 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 267/531] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:18 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:18.923598 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-2cfedd12-67c9-4066-bf5d-cd46ae7690d3 req-18b9eced-3748-4ec3-956f-4381cd7af776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ded003d-59a9-4d0d-a1de-8a83def840d1", "name": "network-vif-deleted", "tag": "726c627f-f6aa-4f9c-95c7-6498c75451a7"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:18.930920 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:07:18.930920 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:07:18.953048 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-2cfedd12-67c9-4066-bf5d-cd46ae7690d3 req-18b9eced-3748-4ec3-956f-4381cd7af776 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:18.956484 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-2cfedd12-67c9-4066-bf5d-cd46ae7690d3 req-18b9eced-3748-4ec3-956f-4381cd7af776 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:18.985319 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-2cfedd12-67c9-4066-bf5d-cd46ae7690d3 req-18b9eced-3748-4ec3-956f-4381cd7af776 service nova] Creating event network-vif-deleted:726c627f-f6aa-4f9c-95c7-6498c75451a7 for instance 2ded003d-59a9-4d0d-a1de-8a83def840d1 on hv-cinder-82182 Dec 15 14:07:19.001804 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-2cfedd12-67c9-4066-bf5d-cd46ae7690d3 req-18b9eced-3748-4ec3-956f-4381cd7af776 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095975 Dec 15 14:07:19.002504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 265/532] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:07:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:07:19.520045 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e0b5f2a6-a6f8-447a-9387-167a91e500cc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:19.521729 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e0b5f2a6-a6f8-447a-9387-167a91e500cc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:19.532404 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e0b5f2a6-a6f8-447a-9387-167a91e500cc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:19.533390 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e0b5f2a6-a6f8-447a-9387-167a91e500cc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:19.534391 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e0b5f2a6-a6f8-447a-9387-167a91e500cc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:19.535189 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e0b5f2a6-a6f8-447a-9387-167a91e500cc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:19.666682 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3a4e7c21-6da5-44aa-8e13-de557281dbc4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:19.670276 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3a4e7c21-6da5-44aa-8e13-de557281dbc4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:19.686758 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3a4e7c21-6da5-44aa-8e13-de557281dbc4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:19.688156 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3a4e7c21-6da5-44aa-8e13-de557281dbc4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:19.689529 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3a4e7c21-6da5-44aa-8e13-de557281dbc4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:19.690213 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3a4e7c21-6da5-44aa-8e13-de557281dbc4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:19.921657 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e0b5f2a6-a6f8-447a-9387-167a91e500cc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:19.936669 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e0b5f2a6-a6f8-447a-9387-167a91e500cc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1567 microversion: 2.1 time: 0.422763 Dec 15 14:07:19.951448 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 268/533] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:19 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1567 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:19.958471 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8c2277f3-747f-443f-8829-2c6578464890 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:19.960890 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8c2277f3-747f-443f-8829-2c6578464890 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [instance: 2ded003d-59a9-4d0d-a1de-8a83def840d1] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:19.969139 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c2277f3-747f-443f-8829-2c6578464890 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:19.971095 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c2277f3-747f-443f-8829-2c6578464890 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:19.972318 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c2277f3-747f-443f-8829-2c6578464890 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:19.972952 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c2277f3-747f-443f-8829-2c6578464890 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:20.020936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3a4e7c21-6da5-44aa-8e13-de557281dbc4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.367194 Dec 15 14:07:20.022112 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 266/534] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:19 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:20.032578 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-40098f27-50d3-45d4-9d4b-9bd0f65701fc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:20.038502 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-40098f27-50d3-45d4-9d4b-9bd0f65701fc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:20.059231 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-40098f27-50d3-45d4-9d4b-9bd0f65701fc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:20.060183 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-40098f27-50d3-45d4-9d4b-9bd0f65701fc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:20.064541 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-40098f27-50d3-45d4-9d4b-9bd0f65701fc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:20.065467 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-40098f27-50d3-45d4-9d4b-9bd0f65701fc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:20.068432 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c2277f3-747f-443f-8829-2c6578464890 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:20.069206 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c2277f3-747f-443f-8829-2c6578464890 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:20.069855 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-8c2277f3-747f-443f-8829-2c6578464890 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lazy-loading 'fault' on Instance uuid 2ded003d-59a9-4d0d-a1de-8a83def840d1 {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:07:20.192914 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8c2277f3-747f-443f-8829-2c6578464890 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a80aace28d422fa6f86e9a5c13ecd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934430ee5cd549c2ab1d0fa14ffcebd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:20.202986 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8c2277f3-747f-443f-8829-2c6578464890 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] 10.222.0.42 "GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1" status: 200 len: 1305 microversion: 2.1 time: 0.249453 Dec 15 14:07:20.203991 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 269/535] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:19 2021] GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1 => generated 1305 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:20.955228 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f2a98c3f-8aac-4fa5-aaa1-a4f5d4388677 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:20.955901 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f2a98c3f-8aac-4fa5-aaa1-a4f5d4388677 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:20.967311 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f2a98c3f-8aac-4fa5-aaa1-a4f5d4388677 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:20.967676 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f2a98c3f-8aac-4fa5-aaa1-a4f5d4388677 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:20.970263 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f2a98c3f-8aac-4fa5-aaa1-a4f5d4388677 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:20.972440 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f2a98c3f-8aac-4fa5-aaa1-a4f5d4388677 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:21.527904 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f2a98c3f-8aac-4fa5-aaa1-a4f5d4388677 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:21.537817 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f2a98c3f-8aac-4fa5-aaa1-a4f5d4388677 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1567 microversion: 2.1 time: 0.586795 Dec 15 14:07:21.542652 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 270/536] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:20 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1567 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:07:21.555696 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-23a9c42b-0b0d-4908-b49d-304a1054720d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:21.556888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-23a9c42b-0b0d-4908-b49d-304a1054720d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:21.567945 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-23a9c42b-0b0d-4908-b49d-304a1054720d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:21.568923 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-23a9c42b-0b0d-4908-b49d-304a1054720d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:21.570110 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-23a9c42b-0b0d-4908-b49d-304a1054720d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:21.570784 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-23a9c42b-0b0d-4908-b49d-304a1054720d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:23.852160 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-40098f27-50d3-45d4-9d4b-9bd0f65701fc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 3.827883 Dec 15 14:07:23.854027 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 267/537] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:20 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 3831 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:23.860945 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-23a9c42b-0b0d-4908-b49d-304a1054720d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 2.316994 Dec 15 14:07:23.861603 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 271/538] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:21 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 2318 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:23.868762 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-87c105d2-a88a-482a-80c9-09c98ecb7570 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:23.869470 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-87c105d2-a88a-482a-80c9-09c98ecb7570 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:23.884549 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8355adf9-6e31-439f-aa09-26e1a0c02454 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:23.885633 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8355adf9-6e31-439f-aa09-26e1a0c02454 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] [instance: 2ded003d-59a9-4d0d-a1de-8a83def840d1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:23.887922 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87c105d2-a88a-482a-80c9-09c98ecb7570 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:23.888368 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87c105d2-a88a-482a-80c9-09c98ecb7570 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:23.892761 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87c105d2-a88a-482a-80c9-09c98ecb7570 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:23.893371 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87c105d2-a88a-482a-80c9-09c98ecb7570 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:23.929489 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8355adf9-6e31-439f-aa09-26e1a0c02454 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:23.932861 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8355adf9-6e31-439f-aa09-26e1a0c02454 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:23.933814 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8355adf9-6e31-439f-aa09-26e1a0c02454 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:23.941792 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8355adf9-6e31-439f-aa09-26e1a0c02454 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:23.986568 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-8355adf9-6e31-439f-aa09-26e1a0c02454 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] HTTP exception thrown: Instance 2ded003d-59a9-4d0d-a1de-8a83def840d1 could not be found. Dec 15 14:07:23.987423 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8355adf9-6e31-439f-aa09-26e1a0c02454 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] Returning 404 to user: Instance 2ded003d-59a9-4d0d-a1de-8a83def840d1 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:07:23.988642 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8355adf9-6e31-439f-aa09-26e1a0c02454 tempest-VolumesNegativeTest-1550690536 tempest-VolumesNegativeTest-1550690536-project] 10.222.0.42 "GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1" status: 404 len: 111 microversion: 2.1 time: 0.132611 Dec 15 14:07:23.989592 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 268/539] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:23 2021] GET /compute/v2.1/servers/2ded003d-59a9-4d0d-a1de-8a83def840d1 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:07:24.301857 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-87c105d2-a88a-482a-80c9-09c98ecb7570 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:24.327560 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-87c105d2-a88a-482a-80c9-09c98ecb7570 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1567 microversion: 2.1 time: 0.456793 Dec 15 14:07:24.332595 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 272/540] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:23 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1567 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:24.867591 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-31412698-fdbe-4453-9bc3-42a906d48245 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:24.870646 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-31412698-fdbe-4453-9bc3-42a906d48245 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:24.877662 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8e0267d0-5b34-40d3-a67e-f2b7bb4f8ea0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:24.879476 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8e0267d0-5b34-40d3-a67e-f2b7bb4f8ea0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:24.896287 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-31412698-fdbe-4453-9bc3-42a906d48245 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:24.897098 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-31412698-fdbe-4453-9bc3-42a906d48245 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:24.903384 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-31412698-fdbe-4453-9bc3-42a906d48245 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:24.904086 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-31412698-fdbe-4453-9bc3-42a906d48245 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:24.904797 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e0267d0-5b34-40d3-a67e-f2b7bb4f8ea0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:24.908110 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e0267d0-5b34-40d3-a67e-f2b7bb4f8ea0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:24.909133 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e0267d0-5b34-40d3-a67e-f2b7bb4f8ea0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:24.910864 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e0267d0-5b34-40d3-a67e-f2b7bb4f8ea0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:24.992993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-31412698-fdbe-4453-9bc3-42a906d48245 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.130329 Dec 15 14:07:24.994112 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 269/541] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:24 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:25.055484 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8e0267d0-5b34-40d3-a67e-f2b7bb4f8ea0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.185906 Dec 15 14:07:25.058138 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 273/542] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:24 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:25.354705 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5b6f629e-6e8b-441c-9051-f9b8abfa1c2a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:25.355548 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5b6f629e-6e8b-441c-9051-f9b8abfa1c2a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:25.376111 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b6f629e-6e8b-441c-9051-f9b8abfa1c2a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:25.377241 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b6f629e-6e8b-441c-9051-f9b8abfa1c2a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:25.378447 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b6f629e-6e8b-441c-9051-f9b8abfa1c2a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:25.380965 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b6f629e-6e8b-441c-9051-f9b8abfa1c2a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:25.877031 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5b6f629e-6e8b-441c-9051-f9b8abfa1c2a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:25.902260 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5b6f629e-6e8b-441c-9051-f9b8abfa1c2a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1567 microversion: 2.1 time: 0.557159 Dec 15 14:07:25.902861 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 270/543] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:25 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1567 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:26.005968 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3458ed58-4d1e-40e9-8fd5-219bbb757ae7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:26.007676 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3458ed58-4d1e-40e9-8fd5-219bbb757ae7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:26.030669 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3458ed58-4d1e-40e9-8fd5-219bbb757ae7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:26.034092 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3458ed58-4d1e-40e9-8fd5-219bbb757ae7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:26.035966 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3458ed58-4d1e-40e9-8fd5-219bbb757ae7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:26.038909 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3458ed58-4d1e-40e9-8fd5-219bbb757ae7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:26.071182 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1645be5d-4be8-4a03-a522-c379f7cfb890 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:26.073179 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1645be5d-4be8-4a03-a522-c379f7cfb890 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:26.096029 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1645be5d-4be8-4a03-a522-c379f7cfb890 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:26.098337 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1645be5d-4be8-4a03-a522-c379f7cfb890 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:26.102112 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1645be5d-4be8-4a03-a522-c379f7cfb890 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:26.102766 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1645be5d-4be8-4a03-a522-c379f7cfb890 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:26.219839 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3458ed58-4d1e-40e9-8fd5-219bbb757ae7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.218284 Dec 15 14:07:26.224375 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 274/544] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:25 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:26.315369 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1645be5d-4be8-4a03-a522-c379f7cfb890 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.231690 Dec 15 14:07:26.318051 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 271/545] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:26 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:26.929052 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1c2311a7-4ee1-4a2f-8280-9233c359c401 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:26.930031 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1c2311a7-4ee1-4a2f-8280-9233c359c401 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:26.947663 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c2311a7-4ee1-4a2f-8280-9233c359c401 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:26.951901 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c2311a7-4ee1-4a2f-8280-9233c359c401 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:26.953064 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c2311a7-4ee1-4a2f-8280-9233c359c401 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:26.953598 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c2311a7-4ee1-4a2f-8280-9233c359c401 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:27.233931 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e0e37629-d5e0-4dcb-bd4c-c15f53ab031c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:27.235849 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e0e37629-d5e0-4dcb-bd4c-c15f53ab031c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:27.262737 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e0e37629-d5e0-4dcb-bd4c-c15f53ab031c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:27.263595 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e0e37629-d5e0-4dcb-bd4c-c15f53ab031c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:27.267151 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e0e37629-d5e0-4dcb-bd4c-c15f53ab031c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:27.267951 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e0e37629-d5e0-4dcb-bd4c-c15f53ab031c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:27.344982 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1c2311a7-4ee1-4a2f-8280-9233c359c401 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:27.361090 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1c2311a7-4ee1-4a2f-8280-9233c359c401 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1567 microversion: 2.1 time: 0.443752 Dec 15 14:07:27.366782 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 275/546] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:26 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1567 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:27.377338 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9ee74af3-2c39-4215-9897-5a5dc6dde647 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:27.378674 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9ee74af3-2c39-4215-9897-5a5dc6dde647 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:27.385181 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ee74af3-2c39-4215-9897-5a5dc6dde647 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:27.385814 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ee74af3-2c39-4215-9897-5a5dc6dde647 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:27.386889 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ee74af3-2c39-4215-9897-5a5dc6dde647 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:27.387437 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ee74af3-2c39-4215-9897-5a5dc6dde647 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:31.055885 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9ee74af3-2c39-4215-9897-5a5dc6dde647 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 3.678851 Dec 15 14:07:31.056699 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 276/547] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:27 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 3689 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:31.081021 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0d734a52-e777-4a0d-8b04-64ccd6918a22 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:31.082682 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e0e37629-d5e0-4dcb-bd4c-c15f53ab031c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 3.853378 Dec 15 14:07:31.084134 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0d734a52-e777-4a0d-8b04-64ccd6918a22 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:31.087259 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 272/548] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:27 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 3859 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:31.106628 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0d734a52-e777-4a0d-8b04-64ccd6918a22 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:31.109687 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0d734a52-e777-4a0d-8b04-64ccd6918a22 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:31.110856 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0d734a52-e777-4a0d-8b04-64ccd6918a22 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:31.111554 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0d734a52-e777-4a0d-8b04-64ccd6918a22 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:31.695118 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0d734a52-e777-4a0d-8b04-64ccd6918a22 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:31.712754 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0d734a52-e777-4a0d-8b04-64ccd6918a22 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1567 microversion: 2.1 time: 0.654850 Dec 15 14:07:31.718549 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 277/549] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:31 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1567 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:31.934896 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4e8f3677-cd68-4f0e-8c1e-44c351711d07 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-257781460", "imageRef": "9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7", "flavorRef": "452", "networks": [{"uuid": "4bd66510-5412-4b6b-8ec9-b734ef6130ab"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:32.068045 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-24af4c5f-f512-435c-ab69-0b2a016116fa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:32.070269 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-24af4c5f-f512-435c-ab69-0b2a016116fa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:32.079702 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-4e8f3677-cd68-4f0e-8c1e-44c351711d07 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] validate_networks() for [('4bd66510-5412-4b6b-8ec9-b734ef6130ab', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:07:32.083037 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-24af4c5f-f512-435c-ab69-0b2a016116fa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:32.086495 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-24af4c5f-f512-435c-ab69-0b2a016116fa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:32.089116 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-24af4c5f-f512-435c-ab69-0b2a016116fa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:32.090188 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-24af4c5f-f512-435c-ab69-0b2a016116fa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:32.224361 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-24af4c5f-f512-435c-ab69-0b2a016116fa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.159714 Dec 15 14:07:32.225443 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 278/550] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:32 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:07:32.234427 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-78d92a70-2671-4d52-b192-f7f4d9d87483 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:32.239053 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-78d92a70-2671-4d52-b192-f7f4d9d87483 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:32.255202 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78d92a70-2671-4d52-b192-f7f4d9d87483 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:32.255861 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78d92a70-2671-4d52-b192-f7f4d9d87483 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:32.256848 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78d92a70-2671-4d52-b192-f7f4d9d87483 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:32.257455 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78d92a70-2671-4d52-b192-f7f4d9d87483 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:32.398834 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-78d92a70-2671-4d52-b192-f7f4d9d87483 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.171695 Dec 15 14:07:32.399983 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 279/551] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:32 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:32.672463 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0f12c00a-f2c3-4dc1-bea3-6a2ffaa2822d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Action: 'create', calling method: .version_select at 0x7faa3c721940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1666222908"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:32.686944 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-0f12c00a-f2c3-4dc1-bea3-6a2ffaa2822d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Getting quotas for project a91c6aedd2b540029697c563f45674ed. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:07:32.691346 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-0f12c00a-f2c3-4dc1-bea3-6a2ffaa2822d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Getting quotas for user ce494e335af643b18361d73fa6a13a3a and project a91c6aedd2b540029697c563f45674ed. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:07:32.896609 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-0f12c00a-f2c3-4dc1-bea3-6a2ffaa2822d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Getting quotas for project a91c6aedd2b540029697c563f45674ed. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:07:32.901076 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-0f12c00a-f2c3-4dc1-bea3-6a2ffaa2822d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Getting quotas for user ce494e335af643b18361d73fa6a13a3a and project a91c6aedd2b540029697c563f45674ed. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:07:32.915484 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0f12c00a-f2c3-4dc1-bea3-6a2ffaa2822d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.513801 Dec 15 14:07:32.916838 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 280/552] 10.222.0.42 () {60 vars in 1157 bytes} [Wed Dec 15 14:07:32 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:32.921798 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-92d2f66d-fe6a-4bbf-90e7-44c9308e31eb tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:32.922735 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-92d2f66d-fe6a-4bbf-90e7-44c9308e31eb tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:32.930187 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92d2f66d-fe6a-4bbf-90e7-44c9308e31eb tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:32.930895 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92d2f66d-fe6a-4bbf-90e7-44c9308e31eb tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:32.932150 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92d2f66d-fe6a-4bbf-90e7-44c9308e31eb tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:32.932838 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92d2f66d-fe6a-4bbf-90e7-44c9308e31eb tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:33.103621 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-4e8f3677-cd68-4f0e-8c1e-44c351711d07 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:07:33.104205 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-4e8f3677-cd68-4f0e-8c1e-44c351711d07 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:07:33.104487 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-4e8f3677-cd68-4f0e-8c1e-44c351711d07 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:07:33.104888 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-4e8f3677-cd68-4f0e-8c1e-44c351711d07 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:07:33.105287 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-4e8f3677-cd68-4f0e-8c1e-44c351711d07 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:07:33.126671 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4e8f3677-cd68-4f0e-8c1e-44c351711d07 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:33.127343 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4e8f3677-cd68-4f0e-8c1e-44c351711d07 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:33.129857 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4e8f3677-cd68-4f0e-8c1e-44c351711d07 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:33.130591 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4e8f3677-cd68-4f0e-8c1e-44c351711d07 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:33.157485 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-4e8f3677-cd68-4f0e-8c1e-44c351711d07 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Getting quotas for project 5eaf014646924970b2c59d6a4b7d7274. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:07:33.162042 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-4e8f3677-cd68-4f0e-8c1e-44c351711d07 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Getting quotas for user 3b87ff00a9da48e5aa3636790bce3772 and project 5eaf014646924970b2c59d6a4b7d7274. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:07:33.184317 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4e8f3677-cd68-4f0e-8c1e-44c351711d07 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:07:33.187127 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4e8f3677-cd68-4f0e-8c1e-44c351711d07 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:07:33.268191 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4e8f3677-cd68-4f0e-8c1e-44c351711d07 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.337369 Dec 15 14:07:33.274178 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 273/553] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Dec 15 14:07:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:07:33.279172 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-349c9098-40bd-457c-837b-50356a0f6c46 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:33.286824 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-349c9098-40bd-457c-837b-50356a0f6c46 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:33.294667 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-349c9098-40bd-457c-837b-50356a0f6c46 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:33.295665 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-349c9098-40bd-457c-837b-50356a0f6c46 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:33.296630 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-349c9098-40bd-457c-837b-50356a0f6c46 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:33.297368 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-349c9098-40bd-457c-837b-50356a0f6c46 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:33.380315 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-92d2f66d-fe6a-4bbf-90e7-44c9308e31eb tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:33.419327 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-92d2f66d-fe6a-4bbf-90e7-44c9308e31eb tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1547 microversion: 2.1 time: 0.501194 Dec 15 14:07:33.426062 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 281/554] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:32 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1547 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:33.433910 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b0062b63-1a9c-4665-897a-0802d5886d1a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:33.434895 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b0062b63-1a9c-4665-897a-0802d5886d1a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:33.461129 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-349c9098-40bd-457c-837b-50356a0f6c46 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.185440 Dec 15 14:07:33.468045 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 274/555] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:33 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:33.478362 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-edb99eae-41b7-45ed-8965-72e5b4694abd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:33.479911 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-edb99eae-41b7-45ed-8965-72e5b4694abd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:33.504659 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-edb99eae-41b7-45ed-8965-72e5b4694abd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:33.515102 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-edb99eae-41b7-45ed-8965-72e5b4694abd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:33.516304 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-edb99eae-41b7-45ed-8965-72e5b4694abd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:33.516769 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-edb99eae-41b7-45ed-8965-72e5b4694abd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:33.624649 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-edb99eae-41b7-45ed-8965-72e5b4694abd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.153079 Dec 15 14:07:33.630800 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 275/556] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:33 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:33.649852 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-591020a7-b8d4-44cd-b8b9-ea8804c8827e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:33.650438 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-591020a7-b8d4-44cd-b8b9-ea8804c8827e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:33.663504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-591020a7-b8d4-44cd-b8b9-ea8804c8827e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:33.675110 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-591020a7-b8d4-44cd-b8b9-ea8804c8827e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:33.676029 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-591020a7-b8d4-44cd-b8b9-ea8804c8827e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:33.676771 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-591020a7-b8d4-44cd-b8b9-ea8804c8827e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:33.693153 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b0062b63-1a9c-4665-897a-0802d5886d1a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:33.700236 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b0062b63-1a9c-4665-897a-0802d5886d1a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1218 microversion: 2.1 time: 0.271818 Dec 15 14:07:33.706154 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 282/557] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:33 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1218 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:33.962732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-591020a7-b8d4-44cd-b8b9-ea8804c8827e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] HTTP exception thrown: Cannot 'detach_volume' instance bfccdaf0-2b79-4ace-a816-8c76eba7f48b while it is in vm_state rescued Dec 15 14:07:33.963399 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-591020a7-b8d4-44cd-b8b9-ea8804c8827e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Returning 409 to user: Cannot 'detach_volume' instance bfccdaf0-2b79-4ace-a816-8c76eba7f48b while it is in vm_state rescued {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:07:33.966377 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-591020a7-b8d4-44cd-b8b9-ea8804c8827e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b/os-volume_attachments/248c6e96-48f0-482f-ba8e-2bdb42ffe110" status: 409 len: 152 microversion: 2.1 time: 0.328434 Dec 15 14:07:33.968001 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 276/558] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Dec 15 14:07:33 2021] DELETE /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b/os-volume_attachments/248c6e96-48f0-482f-ba8e-2bdb42ffe110 => generated 152 bytes in 337 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 15 14:07:33.976913 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-41131475-9fd4-4707-ba14-2cf27775622b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:33.977434 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-41131475-9fd4-4707-ba14-2cf27775622b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:33.992838 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-41131475-9fd4-4707-ba14-2cf27775622b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:33.993511 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-41131475-9fd4-4707-ba14-2cf27775622b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:33.994722 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-41131475-9fd4-4707-ba14-2cf27775622b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:33.995396 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-41131475-9fd4-4707-ba14-2cf27775622b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:34.107824 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-41131475-9fd4-4707-ba14-2cf27775622b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "POST /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b/action" status: 202 len: 0 microversion: 2.1 time: 0.133173 Dec 15 14:07:34.113625 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 283/559] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:33 2021] POST /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:34.117074 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0a349a60-0194-4a35-a704-5c2be5c9a642 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:34.118539 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0a349a60-0194-4a35-a704-5c2be5c9a642 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:34.137601 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0a349a60-0194-4a35-a704-5c2be5c9a642 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:34.138324 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0a349a60-0194-4a35-a704-5c2be5c9a642 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:34.139467 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0a349a60-0194-4a35-a704-5c2be5c9a642 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:34.140112 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0a349a60-0194-4a35-a704-5c2be5c9a642 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:34.477571 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6dfccc09-4b4d-44ef-96b9-3a1c35cccbf9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:34.480393 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6dfccc09-4b4d-44ef-96b9-3a1c35cccbf9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:34.500488 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dfccc09-4b4d-44ef-96b9-3a1c35cccbf9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:34.505363 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dfccc09-4b4d-44ef-96b9-3a1c35cccbf9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:34.507023 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dfccc09-4b4d-44ef-96b9-3a1c35cccbf9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:34.507648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dfccc09-4b4d-44ef-96b9-3a1c35cccbf9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:34.678013 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6dfccc09-4b4d-44ef-96b9-3a1c35cccbf9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.200471 Dec 15 14:07:34.679467 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 284/560] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:34 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:34.692126 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-eaec4ddc-1d2f-4f11-993b-ad4adad19e90 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:34.693521 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-eaec4ddc-1d2f-4f11-993b-ad4adad19e90 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:34.716066 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eaec4ddc-1d2f-4f11-993b-ad4adad19e90 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:34.716929 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eaec4ddc-1d2f-4f11-993b-ad4adad19e90 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:34.720557 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eaec4ddc-1d2f-4f11-993b-ad4adad19e90 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:34.721275 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eaec4ddc-1d2f-4f11-993b-ad4adad19e90 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:34.850707 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-eaec4ddc-1d2f-4f11-993b-ad4adad19e90 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.169542 Dec 15 14:07:34.851753 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 285/561] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:34 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:34.857158 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f3ee188b-58d3-4ae4-b263-c34c5c4558c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:34.864165 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f3ee188b-58d3-4ae4-b263-c34c5c4558c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:34.875763 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f3ee188b-58d3-4ae4-b263-c34c5c4558c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:34.876817 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f3ee188b-58d3-4ae4-b263-c34c5c4558c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:34.878649 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f3ee188b-58d3-4ae4-b263-c34c5c4558c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:34.879430 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f3ee188b-58d3-4ae4-b263-c34c5c4558c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:35.102161 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0a349a60-0194-4a35-a704-5c2be5c9a642 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:35.120601 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0a349a60-0194-4a35-a704-5c2be5c9a642 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1555 microversion: 2.1 time: 1.007162 Dec 15 14:07:35.121249 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 277/562] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:34 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1555 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:07:35.178492 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f3ee188b-58d3-4ae4-b263-c34c5c4558c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:35.189586 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f3ee188b-58d3-4ae4-b263-c34c5c4558c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1288 microversion: 2.1 time: 0.336355 Dec 15 14:07:35.190231 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 286/563] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:34 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1288 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:35.693039 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6e0ba78b-1764-46da-85a1-f7db02a62183 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:35.695091 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6e0ba78b-1764-46da-85a1-f7db02a62183 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:35.705152 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6e0ba78b-1764-46da-85a1-f7db02a62183 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:35.708142 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6e0ba78b-1764-46da-85a1-f7db02a62183 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:35.709152 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6e0ba78b-1764-46da-85a1-f7db02a62183 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:35.710093 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6e0ba78b-1764-46da-85a1-f7db02a62183 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:35.851345 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6e0ba78b-1764-46da-85a1-f7db02a62183 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.163667 Dec 15 14:07:35.852273 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 278/564] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:35 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:35.863404 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d2767ad1-9e0b-45a8-b9be-2d63f87f58fd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:35.865009 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d2767ad1-9e0b-45a8-b9be-2d63f87f58fd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:35.875264 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d2767ad1-9e0b-45a8-b9be-2d63f87f58fd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:35.875945 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d2767ad1-9e0b-45a8-b9be-2d63f87f58fd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:35.877574 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d2767ad1-9e0b-45a8-b9be-2d63f87f58fd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:35.878384 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d2767ad1-9e0b-45a8-b9be-2d63f87f58fd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:36.031750 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d2767ad1-9e0b-45a8-b9be-2d63f87f58fd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.171138 Dec 15 14:07:36.034581 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 287/565] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:35 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:36.141739 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a6883058-0f95-4565-952a-e57b8430fd38 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:36.142451 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a6883058-0f95-4565-952a-e57b8430fd38 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:36.171806 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a6883058-0f95-4565-952a-e57b8430fd38 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:36.172495 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a6883058-0f95-4565-952a-e57b8430fd38 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:36.173491 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a6883058-0f95-4565-952a-e57b8430fd38 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:36.174112 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a6883058-0f95-4565-952a-e57b8430fd38 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:36.212175 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bddf80a4-8649-4f85-81d3-228c87346add tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:36.213120 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bddf80a4-8649-4f85-81d3-228c87346add tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:36.221731 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bddf80a4-8649-4f85-81d3-228c87346add tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:36.222361 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bddf80a4-8649-4f85-81d3-228c87346add tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:36.223424 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bddf80a4-8649-4f85-81d3-228c87346add tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:36.224024 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bddf80a4-8649-4f85-81d3-228c87346add tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:36.363270 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bddf80a4-8649-4f85-81d3-228c87346add tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:36.375594 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bddf80a4-8649-4f85-81d3-228c87346add tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1276 microversion: 2.1 time: 0.171685 Dec 15 14:07:36.376356 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 288/566] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:36 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1276 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:07:36.671986 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a6883058-0f95-4565-952a-e57b8430fd38 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:36.681057 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a6883058-0f95-4565-952a-e57b8430fd38 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1555 microversion: 2.1 time: 0.543753 Dec 15 14:07:36.681688 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 279/567] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:36 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1555 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:36.865537 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bce42dcf-88b8-40fa-8278-c0814a305843 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:36.867834 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bce42dcf-88b8-40fa-8278-c0814a305843 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:36.876788 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bce42dcf-88b8-40fa-8278-c0814a305843 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:36.877813 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bce42dcf-88b8-40fa-8278-c0814a305843 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:36.878624 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bce42dcf-88b8-40fa-8278-c0814a305843 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:36.879339 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bce42dcf-88b8-40fa-8278-c0814a305843 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:37.026319 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bce42dcf-88b8-40fa-8278-c0814a305843 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.165766 Dec 15 14:07:37.027262 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 289/568] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:36 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:07:37.045723 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0cd29cbc-1a94-4b01-8ad0-95ee387d668b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:37.047005 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0cd29cbc-1a94-4b01-8ad0-95ee387d668b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:37.053802 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0cd29cbc-1a94-4b01-8ad0-95ee387d668b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:37.054480 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0cd29cbc-1a94-4b01-8ad0-95ee387d668b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:37.055484 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0cd29cbc-1a94-4b01-8ad0-95ee387d668b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:37.056071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0cd29cbc-1a94-4b01-8ad0-95ee387d668b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:37.150070 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0cd29cbc-1a94-4b01-8ad0-95ee387d668b tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.109093 Dec 15 14:07:37.151721 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 280/569] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:37 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:37.395005 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-87302543-c264-405c-ae34-2a0876c4cf58 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:37.395861 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-87302543-c264-405c-ae34-2a0876c4cf58 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:37.415352 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87302543-c264-405c-ae34-2a0876c4cf58 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:37.416259 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87302543-c264-405c-ae34-2a0876c4cf58 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:37.417243 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87302543-c264-405c-ae34-2a0876c4cf58 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:37.417900 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87302543-c264-405c-ae34-2a0876c4cf58 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:37.702311 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7136f0cf-6132-4a55-9131-1c0c862f13a7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:37.703337 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7136f0cf-6132-4a55-9131-1c0c862f13a7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:37.712190 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7136f0cf-6132-4a55-9131-1c0c862f13a7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:37.712882 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7136f0cf-6132-4a55-9131-1c0c862f13a7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:37.714264 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7136f0cf-6132-4a55-9131-1c0c862f13a7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:37.714979 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7136f0cf-6132-4a55-9131-1c0c862f13a7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:38.066574 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-87302543-c264-405c-ae34-2a0876c4cf58 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:38.084909 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-87302543-c264-405c-ae34-2a0876c4cf58 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1318 microversion: 2.1 time: 0.694748 Dec 15 14:07:38.086139 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 290/570] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:37 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1318 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:38.102366 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6f8c33d9-c5fe-4836-a45d-ae7b22e8c4fe tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:38.104105 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6f8c33d9-c5fe-4836-a45d-ae7b22e8c4fe tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:38.112870 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f8c33d9-c5fe-4836-a45d-ae7b22e8c4fe tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:38.113829 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f8c33d9-c5fe-4836-a45d-ae7b22e8c4fe tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:38.115062 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f8c33d9-c5fe-4836-a45d-ae7b22e8c4fe tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:38.116966 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f8c33d9-c5fe-4836-a45d-ae7b22e8c4fe tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:38.129513 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7136f0cf-6132-4a55-9131-1c0c862f13a7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:38.140764 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7136f0cf-6132-4a55-9131-1c0c862f13a7 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1555 microversion: 2.1 time: 0.442449 Dec 15 14:07:38.144846 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 281/571] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:37 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1555 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:07:38.156774 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-3d2b6ff2-68de-4cbf-afc5-36d6686ead43 req-4307837b-bddf-4a40-b7d0-c32a11e5b5ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95358386-841b-4e1b-9d6b-8fdc3751799f", "tag": "83ecfae9-7ad0-4a5f-a870-5c76e803e8d1"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:38.163512 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:07:38.163512 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:07:38.188084 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-3d2b6ff2-68de-4cbf-afc5-36d6686ead43 req-4307837b-bddf-4a40-b7d0-c32a11e5b5ee service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:38.189154 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-3d2b6ff2-68de-4cbf-afc5-36d6686ead43 req-4307837b-bddf-4a40-b7d0-c32a11e5b5ee service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:38.206117 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-3d2b6ff2-68de-4cbf-afc5-36d6686ead43 req-4307837b-bddf-4a40-b7d0-c32a11e5b5ee service nova] Creating event network-changed:83ecfae9-7ad0-4a5f-a870-5c76e803e8d1 for instance 95358386-841b-4e1b-9d6b-8fdc3751799f on hv-cinder-82182 Dec 15 14:07:38.212183 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-3d2b6ff2-68de-4cbf-afc5-36d6686ead43 req-4307837b-bddf-4a40-b7d0-c32a11e5b5ee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063158 Dec 15 14:07:38.212835 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 282/572] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:07:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:07:38.218925 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7654bbc2-3a0b-4cdd-b7ff-2ee8640da5d3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:38.220322 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7654bbc2-3a0b-4cdd-b7ff-2ee8640da5d3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:38.228193 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7654bbc2-3a0b-4cdd-b7ff-2ee8640da5d3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:38.228645 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7654bbc2-3a0b-4cdd-b7ff-2ee8640da5d3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:38.229631 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7654bbc2-3a0b-4cdd-b7ff-2ee8640da5d3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:38.230224 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7654bbc2-3a0b-4cdd-b7ff-2ee8640da5d3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:38.282925 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6f8c33d9-c5fe-4836-a45d-ae7b22e8c4fe tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.195273 Dec 15 14:07:38.283957 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 291/573] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:38 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:38.324893 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7654bbc2-3a0b-4cdd-b7ff-2ee8640da5d3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.110410 Dec 15 14:07:38.325538 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 283/574] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:38 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:39.106820 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-39ae435a-d65d-4ca2-9ac6-fe69d4a31c87 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:39.110122 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-39ae435a-d65d-4ca2-9ac6-fe69d4a31c87 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:39.130758 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-39ae435a-d65d-4ca2-9ac6-fe69d4a31c87 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:39.131490 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-39ae435a-d65d-4ca2-9ac6-fe69d4a31c87 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:39.132474 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-39ae435a-d65d-4ca2-9ac6-fe69d4a31c87 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:39.137185 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-39ae435a-d65d-4ca2-9ac6-fe69d4a31c87 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:39.165179 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-89a3b885-f033-4d9a-a136-9831aae02e4b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:39.166631 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-89a3b885-f033-4d9a-a136-9831aae02e4b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:39.187042 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-89a3b885-f033-4d9a-a136-9831aae02e4b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:39.187600 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-89a3b885-f033-4d9a-a136-9831aae02e4b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:39.189828 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-89a3b885-f033-4d9a-a136-9831aae02e4b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:39.190649 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-89a3b885-f033-4d9a-a136-9831aae02e4b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:39.571417 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-39ae435a-d65d-4ca2-9ac6-fe69d4a31c87 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:39.589541 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-39ae435a-d65d-4ca2-9ac6-fe69d4a31c87 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1318 microversion: 2.1 time: 0.489580 Dec 15 14:07:39.600071 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 292/575] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:39 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:39.600817 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-89a3b885-f033-4d9a-a136-9831aae02e4b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:39.606026 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-67ba45af-ad6b-4b63-97ef-362d3256c6e5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:39.608109 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-67ba45af-ad6b-4b63-97ef-362d3256c6e5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:39.617836 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67ba45af-ad6b-4b63-97ef-362d3256c6e5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:39.618675 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67ba45af-ad6b-4b63-97ef-362d3256c6e5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:39.624949 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67ba45af-ad6b-4b63-97ef-362d3256c6e5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:39.625888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67ba45af-ad6b-4b63-97ef-362d3256c6e5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:39.640409 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-89a3b885-f033-4d9a-a136-9831aae02e4b tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1555 microversion: 2.1 time: 0.479088 Dec 15 14:07:39.644479 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 284/576] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:39 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1555 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:39.676345 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ef102ea1-1071-45b9-8fc2-6b802a60996c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:39.678482 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ef102ea1-1071-45b9-8fc2-6b802a60996c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:39.695787 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef102ea1-1071-45b9-8fc2-6b802a60996c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:39.696245 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef102ea1-1071-45b9-8fc2-6b802a60996c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:39.697549 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef102ea1-1071-45b9-8fc2-6b802a60996c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:39.698119 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef102ea1-1071-45b9-8fc2-6b802a60996c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:39.740912 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-67ba45af-ad6b-4b63-97ef-362d3256c6e5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.139012 Dec 15 14:07:39.751979 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 293/577] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:39 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:39.860446 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ef102ea1-1071-45b9-8fc2-6b802a60996c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.209916 Dec 15 14:07:39.864978 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 285/578] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:39 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:40.616840 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-30d02e8a-f4dd-42cc-8306-ed929c0962b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:40.617603 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-30d02e8a-f4dd-42cc-8306-ed929c0962b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:40.626587 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30d02e8a-f4dd-42cc-8306-ed929c0962b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:40.626968 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30d02e8a-f4dd-42cc-8306-ed929c0962b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:40.627968 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30d02e8a-f4dd-42cc-8306-ed929c0962b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:40.628414 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30d02e8a-f4dd-42cc-8306-ed929c0962b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:40.662418 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d1e7d4b5-3b9c-445a-afa1-f2ee2f9da10f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:40.663758 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d1e7d4b5-3b9c-445a-afa1-f2ee2f9da10f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:40.672366 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1e7d4b5-3b9c-445a-afa1-f2ee2f9da10f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:40.673125 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1e7d4b5-3b9c-445a-afa1-f2ee2f9da10f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:40.674565 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1e7d4b5-3b9c-445a-afa1-f2ee2f9da10f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:40.675157 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1e7d4b5-3b9c-445a-afa1-f2ee2f9da10f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:41.125039 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-30d02e8a-f4dd-42cc-8306-ed929c0962b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:41.138067 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-30d02e8a-f4dd-42cc-8306-ed929c0962b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1318 microversion: 2.1 time: 0.523738 Dec 15 14:07:41.142102 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 294/579] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:40 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:41.148232 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d1e7d4b5-3b9c-445a-afa1-f2ee2f9da10f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:41.160949 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d1e7d4b5-3b9c-445a-afa1-f2ee2f9da10f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1561 microversion: 2.1 time: 0.503068 Dec 15 14:07:41.166870 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bc36bae6-3052-4d5d-a9b6-6572a081f574 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:41.167756 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bc36bae6-3052-4d5d-a9b6-6572a081f574 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:41.168948 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 286/580] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:40 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1561 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:41.200609 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f07a5be5-14e9-472a-959f-5c0f33ee497e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:41.201687 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f07a5be5-14e9-472a-959f-5c0f33ee497e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:41.212178 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc36bae6-3052-4d5d-a9b6-6572a081f574 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:41.212655 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc36bae6-3052-4d5d-a9b6-6572a081f574 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:41.213502 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc36bae6-3052-4d5d-a9b6-6572a081f574 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:41.217469 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc36bae6-3052-4d5d-a9b6-6572a081f574 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:41.232526 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f07a5be5-14e9-472a-959f-5c0f33ee497e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:41.233095 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f07a5be5-14e9-472a-959f-5c0f33ee497e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:41.238573 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f07a5be5-14e9-472a-959f-5c0f33ee497e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:41.239083 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f07a5be5-14e9-472a-959f-5c0f33ee497e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:41.354462 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bc36bae6-3052-4d5d-a9b6-6572a081f574 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.210499 Dec 15 14:07:41.355892 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 295/581] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:41 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:41.366554 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d4bc2cf2-cbaa-4331-90aa-3c361cfbcddc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:41.367209 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d4bc2cf2-cbaa-4331-90aa-3c361cfbcddc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:41.393562 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4bc2cf2-cbaa-4331-90aa-3c361cfbcddc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:41.394044 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4bc2cf2-cbaa-4331-90aa-3c361cfbcddc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:41.394912 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4bc2cf2-cbaa-4331-90aa-3c361cfbcddc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:41.395329 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4bc2cf2-cbaa-4331-90aa-3c361cfbcddc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:41.410022 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f07a5be5-14e9-472a-959f-5c0f33ee497e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.239614 Dec 15 14:07:41.410950 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 287/582] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:41 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:41.586889 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-d4bc2cf2-cbaa-4331-90aa-3c361cfbcddc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lazy-loading 'services' on Instance uuid bfccdaf0-2b79-4ace-a816-8c76eba7f48b {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:07:41.733159 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d4bc2cf2-cbaa-4331-90aa-3c361cfbcddc tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b/os-volume_attachments/248c6e96-48f0-482f-ba8e-2bdb42ffe110" status: 202 len: 0 microversion: 2.1 time: 0.368233 Dec 15 14:07:41.742448 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 296/583] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Dec 15 14:07:41 2021] DELETE /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b/os-volume_attachments/248c6e96-48f0-482f-ba8e-2bdb42ffe110 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:41.752920 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-174d774b-4826-49b0-b2b3-b45df17da269 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:41.755154 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-174d774b-4826-49b0-b2b3-b45df17da269 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:41.796099 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-174d774b-4826-49b0-b2b3-b45df17da269 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:41.799525 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-174d774b-4826-49b0-b2b3-b45df17da269 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:41.804187 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-174d774b-4826-49b0-b2b3-b45df17da269 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:41.804834 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-174d774b-4826-49b0-b2b3-b45df17da269 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:41.889338 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-174d774b-4826-49b0-b2b3-b45df17da269 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137874 Dec 15 14:07:41.893800 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 288/584] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Dec 15 14:07:41 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:07:42.157575 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-675bf820-5c45-488d-acbd-01a3f6928dbe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:42.160129 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-675bf820-5c45-488d-acbd-01a3f6928dbe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:42.172385 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-675bf820-5c45-488d-acbd-01a3f6928dbe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:42.172830 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-675bf820-5c45-488d-acbd-01a3f6928dbe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:42.173655 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-675bf820-5c45-488d-acbd-01a3f6928dbe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:42.174090 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-675bf820-5c45-488d-acbd-01a3f6928dbe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:42.365649 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-675bf820-5c45-488d-acbd-01a3f6928dbe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:42.366919 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0b2f4a77-aa3e-4f67-8126-56fba36c0f9d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:42.368213 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0b2f4a77-aa3e-4f67-8126-56fba36c0f9d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:42.375337 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-675bf820-5c45-488d-acbd-01a3f6928dbe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1318 microversion: 2.1 time: 0.222603 Dec 15 14:07:42.375929 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 297/585] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:42 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:42.384771 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0b2f4a77-aa3e-4f67-8126-56fba36c0f9d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:42.385523 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0b2f4a77-aa3e-4f67-8126-56fba36c0f9d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:42.386550 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0b2f4a77-aa3e-4f67-8126-56fba36c0f9d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:42.386988 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0b2f4a77-aa3e-4f67-8126-56fba36c0f9d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:42.432207 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-af00104f-1e42-40a3-bb9c-adba90a80dca tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:42.433237 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-af00104f-1e42-40a3-bb9c-adba90a80dca tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:42.449059 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af00104f-1e42-40a3-bb9c-adba90a80dca tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:42.452747 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af00104f-1e42-40a3-bb9c-adba90a80dca tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:42.454003 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af00104f-1e42-40a3-bb9c-adba90a80dca tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:42.454500 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af00104f-1e42-40a3-bb9c-adba90a80dca tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:42.562975 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0b2f4a77-aa3e-4f67-8126-56fba36c0f9d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.199510 Dec 15 14:07:42.563642 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 289/586] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:42 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:42.583715 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-af00104f-1e42-40a3-bb9c-adba90a80dca tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.162407 Dec 15 14:07:42.584847 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 298/587] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:42 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:42.901527 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-87b50cd8-c36f-49c1-8af2-9d1dedd05e8d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:42.902644 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-87b50cd8-c36f-49c1-8af2-9d1dedd05e8d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:42.921285 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87b50cd8-c36f-49c1-8af2-9d1dedd05e8d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:42.921780 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87b50cd8-c36f-49c1-8af2-9d1dedd05e8d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:42.922595 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87b50cd8-c36f-49c1-8af2-9d1dedd05e8d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:42.923042 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87b50cd8-c36f-49c1-8af2-9d1dedd05e8d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:43.016105 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-87b50cd8-c36f-49c1-8af2-9d1dedd05e8d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.119140 Dec 15 14:07:43.017243 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 290/588] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Dec 15 14:07:42 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:07:43.394149 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7fd237b7-d38a-44ed-8d58-db403a7d19ae tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:43.395616 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7fd237b7-d38a-44ed-8d58-db403a7d19ae tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:43.405441 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fd237b7-d38a-44ed-8d58-db403a7d19ae tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:43.406187 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fd237b7-d38a-44ed-8d58-db403a7d19ae tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:43.407294 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fd237b7-d38a-44ed-8d58-db403a7d19ae tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:43.407897 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fd237b7-d38a-44ed-8d58-db403a7d19ae tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:43.578109 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7cff3fa0-09d2-4ebb-87fa-6dac37dfb22e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:43.579586 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7cff3fa0-09d2-4ebb-87fa-6dac37dfb22e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:43.599326 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7cff3fa0-09d2-4ebb-87fa-6dac37dfb22e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:43.605072 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7cff3fa0-09d2-4ebb-87fa-6dac37dfb22e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:43.609516 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7cff3fa0-09d2-4ebb-87fa-6dac37dfb22e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:43.615179 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7cff3fa0-09d2-4ebb-87fa-6dac37dfb22e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:43.713382 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7fd237b7-d38a-44ed-8d58-db403a7d19ae tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:43.725877 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7fd237b7-d38a-44ed-8d58-db403a7d19ae tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1318 microversion: 2.1 time: 0.336949 Dec 15 14:07:43.727367 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 299/589] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:43 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:07:43.740798 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c164e6b6-cb0e-4363-9cb4-a9e1b7e3c21c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:43.742279 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c164e6b6-cb0e-4363-9cb4-a9e1b7e3c21c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:43.751046 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c164e6b6-cb0e-4363-9cb4-a9e1b7e3c21c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:43.751978 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c164e6b6-cb0e-4363-9cb4-a9e1b7e3c21c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:43.753064 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c164e6b6-cb0e-4363-9cb4-a9e1b7e3c21c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:43.753731 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c164e6b6-cb0e-4363-9cb4-a9e1b7e3c21c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:43.761890 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7cff3fa0-09d2-4ebb-87fa-6dac37dfb22e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.190176 Dec 15 14:07:43.765598 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 291/590] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:43 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:07:43.859205 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c164e6b6-cb0e-4363-9cb4-a9e1b7e3c21c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.129057 Dec 15 14:07:43.860326 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 300/591] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:43 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:44.748939 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f02ce8f9-aed0-41ad-b5e3-117ed7ec5cd3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:44.758011 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f02ce8f9-aed0-41ad-b5e3-117ed7ec5cd3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:44.771307 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f02ce8f9-aed0-41ad-b5e3-117ed7ec5cd3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:44.771307 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f02ce8f9-aed0-41ad-b5e3-117ed7ec5cd3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:44.771307 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f02ce8f9-aed0-41ad-b5e3-117ed7ec5cd3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:44.771721 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f02ce8f9-aed0-41ad-b5e3-117ed7ec5cd3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:44.777669 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7158e07c-7ddd-486e-b133-4d9e4cc0dd8f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:44.778742 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7158e07c-7ddd-486e-b133-4d9e4cc0dd8f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:44.796949 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7158e07c-7ddd-486e-b133-4d9e4cc0dd8f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:44.806053 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7158e07c-7ddd-486e-b133-4d9e4cc0dd8f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:44.807293 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7158e07c-7ddd-486e-b133-4d9e4cc0dd8f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:44.813403 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7158e07c-7ddd-486e-b133-4d9e4cc0dd8f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:45.075075 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7158e07c-7ddd-486e-b133-4d9e4cc0dd8f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.300954 Dec 15 14:07:45.080842 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 301/592] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:44 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:45.094789 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1505c3d8-369f-43c0-a8f0-5ce8fe90cd38 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:45.096186 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1505c3d8-369f-43c0-a8f0-5ce8fe90cd38 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:45.110309 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1505c3d8-369f-43c0-a8f0-5ce8fe90cd38 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:45.111169 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1505c3d8-369f-43c0-a8f0-5ce8fe90cd38 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:45.112253 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1505c3d8-369f-43c0-a8f0-5ce8fe90cd38 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:45.112747 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1505c3d8-369f-43c0-a8f0-5ce8fe90cd38 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:45.208663 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f02ce8f9-aed0-41ad-b5e3-117ed7ec5cd3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:45.217400 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f02ce8f9-aed0-41ad-b5e3-117ed7ec5cd3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1318 microversion: 2.1 time: 0.474542 Dec 15 14:07:45.220996 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 292/593] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:44 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:45.249964 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1505c3d8-369f-43c0-a8f0-5ce8fe90cd38 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.165387 Dec 15 14:07:45.254457 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 302/594] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:45 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:45.545070 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1a2e9f14-1e99-411a-824a-35b4e8916e44 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:45.545861 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1a2e9f14-1e99-411a-824a-35b4e8916e44 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:45.552997 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1a2e9f14-1e99-411a-824a-35b4e8916e44 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:45.553350 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1a2e9f14-1e99-411a-824a-35b4e8916e44 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:45.554472 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1a2e9f14-1e99-411a-824a-35b4e8916e44 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:45.554908 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1a2e9f14-1e99-411a-824a-35b4e8916e44 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:45.587963 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1a2e9f14-1e99-411a-824a-35b4e8916e44 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:07:45.717270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1a2e9f14-1e99-411a-824a-35b4e8916e44 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 204 len: 0 microversion: 2.1 time: 0.174908 Dec 15 14:07:45.720458 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 293/595] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:07:45 2021] DELETE /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:07:45.730107 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b4e14862-ba0f-4aeb-99c2-7fc04004cf66 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:45.731049 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b4e14862-ba0f-4aeb-99c2-7fc04004cf66 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:45.739310 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b4e14862-ba0f-4aeb-99c2-7fc04004cf66 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:45.740123 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b4e14862-ba0f-4aeb-99c2-7fc04004cf66 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:45.741143 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b4e14862-ba0f-4aeb-99c2-7fc04004cf66 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:45.741793 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b4e14862-ba0f-4aeb-99c2-7fc04004cf66 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:45.918109 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b4e14862-ba0f-4aeb-99c2-7fc04004cf66 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:45.934383 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b4e14862-ba0f-4aeb-99c2-7fc04004cf66 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1506 microversion: 2.1 time: 0.208966 Dec 15 14:07:45.935999 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 303/596] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:45 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:46.089436 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-22a1aca3-5682-41a6-8d54-fc0961b6ece8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:46.090599 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-22a1aca3-5682-41a6-8d54-fc0961b6ece8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:46.099402 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-22a1aca3-5682-41a6-8d54-fc0961b6ece8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:46.100213 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-22a1aca3-5682-41a6-8d54-fc0961b6ece8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:46.101472 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-22a1aca3-5682-41a6-8d54-fc0961b6ece8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:46.101949 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-22a1aca3-5682-41a6-8d54-fc0961b6ece8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:46.189157 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-22a1aca3-5682-41a6-8d54-fc0961b6ece8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.104491 Dec 15 14:07:46.189845 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 294/597] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:46 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:46.243007 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9ccab92a-cbe6-455c-bace-347058b8a7f9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:46.243741 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9ccab92a-cbe6-455c-bace-347058b8a7f9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:46.255259 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ccab92a-cbe6-455c-bace-347058b8a7f9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:46.255719 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ccab92a-cbe6-455c-bace-347058b8a7f9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:46.256528 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ccab92a-cbe6-455c-bace-347058b8a7f9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:46.259151 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ccab92a-cbe6-455c-bace-347058b8a7f9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:46.265380 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5f4c6c1a-ff81-4137-9073-bc57ba7f23fe tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:46.269646 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5f4c6c1a-ff81-4137-9073-bc57ba7f23fe tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:46.302806 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f4c6c1a-ff81-4137-9073-bc57ba7f23fe tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:46.303526 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f4c6c1a-ff81-4137-9073-bc57ba7f23fe tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:46.304527 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f4c6c1a-ff81-4137-9073-bc57ba7f23fe tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:46.306942 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f4c6c1a-ff81-4137-9073-bc57ba7f23fe tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:46.405439 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5f4c6c1a-ff81-4137-9073-bc57ba7f23fe tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.144418 Dec 15 14:07:46.406796 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 295/598] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:46 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:46.474588 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9ccab92a-cbe6-455c-bace-347058b8a7f9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:46.493651 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9ccab92a-cbe6-455c-bace-347058b8a7f9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1318 microversion: 2.1 time: 0.248921 Dec 15 14:07:46.493651 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 304/599] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:46 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:46.562041 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-4308d4cd-9a7d-446c-8ba7-825d1fac7213 req-ac126e28-3d1b-4148-9049-07f1c4b14fad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95358386-841b-4e1b-9d6b-8fdc3751799f", "name": "network-vif-plugged", "status": "completed", "tag": "83ecfae9-7ad0-4a5f-a870-5c76e803e8d1"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:46.564015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:07:46.564015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:07:46.573278 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-4308d4cd-9a7d-446c-8ba7-825d1fac7213 req-ac126e28-3d1b-4148-9049-07f1c4b14fad service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:46.574048 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-4308d4cd-9a7d-446c-8ba7-825d1fac7213 req-ac126e28-3d1b-4148-9049-07f1c4b14fad service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:46.588558 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-4308d4cd-9a7d-446c-8ba7-825d1fac7213 req-ac126e28-3d1b-4148-9049-07f1c4b14fad service nova] Creating event network-vif-plugged:83ecfae9-7ad0-4a5f-a870-5c76e803e8d1 for instance 95358386-841b-4e1b-9d6b-8fdc3751799f on hv-cinder-82182 Dec 15 14:07:46.594134 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-4308d4cd-9a7d-446c-8ba7-825d1fac7213 req-ac126e28-3d1b-4148-9049-07f1c4b14fad service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036345 Dec 15 14:07:46.595123 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 296/600] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:07:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:07:46.954363 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f7fb265a-1249-4e4a-bb97-e6716ab1e88a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:46.955844 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f7fb265a-1249-4e4a-bb97-e6716ab1e88a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:46.967195 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7fb265a-1249-4e4a-bb97-e6716ab1e88a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:46.968086 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7fb265a-1249-4e4a-bb97-e6716ab1e88a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:46.969059 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7fb265a-1249-4e4a-bb97-e6716ab1e88a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:46.969678 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7fb265a-1249-4e4a-bb97-e6716ab1e88a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:47.150395 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f7fb265a-1249-4e4a-bb97-e6716ab1e88a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:47.158798 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f7fb265a-1249-4e4a-bb97-e6716ab1e88a tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1506 microversion: 2.1 time: 0.210244 Dec 15 14:07:47.159380 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 305/601] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:46 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:47.202506 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f80c15ab-4c2c-4e6e-b626-d82368b937f2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:47.204865 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f80c15ab-4c2c-4e6e-b626-d82368b937f2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:47.211604 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f80c15ab-4c2c-4e6e-b626-d82368b937f2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:47.212064 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f80c15ab-4c2c-4e6e-b626-d82368b937f2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:47.213154 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f80c15ab-4c2c-4e6e-b626-d82368b937f2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:47.213592 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f80c15ab-4c2c-4e6e-b626-d82368b937f2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:47.407011 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f80c15ab-4c2c-4e6e-b626-d82368b937f2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.209471 Dec 15 14:07:47.407829 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 297/602] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:47 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:47.417777 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c3c763df-bd79-44e3-a639-dddc70b0a870 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:47.418989 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c3c763df-bd79-44e3-a639-dddc70b0a870 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:47.429146 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3c763df-bd79-44e3-a639-dddc70b0a870 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:47.429597 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3c763df-bd79-44e3-a639-dddc70b0a870 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:47.431362 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3c763df-bd79-44e3-a639-dddc70b0a870 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:47.431807 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3c763df-bd79-44e3-a639-dddc70b0a870 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:47.506220 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-886b4661-cd8c-4476-844d-dcf500d4f869 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:47.506902 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-886b4661-cd8c-4476-844d-dcf500d4f869 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:47.514567 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-886b4661-cd8c-4476-844d-dcf500d4f869 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:47.515028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-886b4661-cd8c-4476-844d-dcf500d4f869 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:47.519049 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-886b4661-cd8c-4476-844d-dcf500d4f869 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:47.519493 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-886b4661-cd8c-4476-844d-dcf500d4f869 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:47.616394 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c3c763df-bd79-44e3-a639-dddc70b0a870 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.202112 Dec 15 14:07:47.622809 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 306/603] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:47 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:47.673067 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-886b4661-cd8c-4476-844d-dcf500d4f869 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:47.681024 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-886b4661-cd8c-4476-844d-dcf500d4f869 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1318 microversion: 2.1 time: 0.178773 Dec 15 14:07:47.683105 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 298/604] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:47 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:07:48.178548 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-53ca6f07-c9f7-420f-b583-95cd2aed0792 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:48.180452 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-53ca6f07-c9f7-420f-b583-95cd2aed0792 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:48.189401 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53ca6f07-c9f7-420f-b583-95cd2aed0792 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:48.189777 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53ca6f07-c9f7-420f-b583-95cd2aed0792 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:48.198106 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53ca6f07-c9f7-420f-b583-95cd2aed0792 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:48.198913 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53ca6f07-c9f7-420f-b583-95cd2aed0792 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:48.352101 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-53ca6f07-c9f7-420f-b583-95cd2aed0792 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:48.360532 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-53ca6f07-c9f7-420f-b583-95cd2aed0792 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1506 microversion: 2.1 time: 0.187220 Dec 15 14:07:48.371596 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 307/605] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:48 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:48.425658 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a56da916-ab40-4158-853b-c625e196d6cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:48.428099 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a56da916-ab40-4158-853b-c625e196d6cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:48.435543 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a56da916-ab40-4158-853b-c625e196d6cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:48.436105 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a56da916-ab40-4158-853b-c625e196d6cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:48.436914 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a56da916-ab40-4158-853b-c625e196d6cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:48.437349 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a56da916-ab40-4158-853b-c625e196d6cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:48.542425 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a56da916-ab40-4158-853b-c625e196d6cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.120172 Dec 15 14:07:48.543108 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 299/606] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:48 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:48.633162 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c4b225cc-2091-4568-916d-7a834203a835 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:48.634428 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c4b225cc-2091-4568-916d-7a834203a835 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:48.641216 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4b225cc-2091-4568-916d-7a834203a835 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:48.641692 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4b225cc-2091-4568-916d-7a834203a835 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:48.642490 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4b225cc-2091-4568-916d-7a834203a835 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:48.642921 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4b225cc-2091-4568-916d-7a834203a835 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:48.700088 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-34aa239e-0249-42e7-a330-db26844e46ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:48.700868 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-34aa239e-0249-42e7-a330-db26844e46ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:48.709209 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34aa239e-0249-42e7-a330-db26844e46ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:48.709654 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34aa239e-0249-42e7-a330-db26844e46ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:48.710466 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34aa239e-0249-42e7-a330-db26844e46ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:48.710899 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34aa239e-0249-42e7-a330-db26844e46ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:48.754302 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c4b225cc-2091-4568-916d-7a834203a835 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.124538 Dec 15 14:07:48.758048 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 308/607] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:48 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:48.782443 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-88aa3e05-128a-48b9-b0c6-46b3f10280d7 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Action: 'create', calling method: .version_select at 0x7faa3c8d1af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1996515674"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:48.800463 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-88aa3e05-128a-48b9-b0c6-46b3f10280d7 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Getting quotas for project 9192905d4b3645ddb643adaa1439e32d. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:07:48.806832 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-88aa3e05-128a-48b9-b0c6-46b3f10280d7 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Getting quotas for user 5e174c52ded9449ebdea2ce7263c8038 and project 9192905d4b3645ddb643adaa1439e32d. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:07:48.857484 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-34aa239e-0249-42e7-a330-db26844e46ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:48.865141 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-34aa239e-0249-42e7-a330-db26844e46ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1318 microversion: 2.1 time: 0.169667 Dec 15 14:07:48.865726 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 300/608] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:48 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:07:49.164030 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-88aa3e05-128a-48b9-b0c6-46b3f10280d7 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Getting quotas for project 9192905d4b3645ddb643adaa1439e32d. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:07:49.170171 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-88aa3e05-128a-48b9-b0c6-46b3f10280d7 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Getting quotas for user 5e174c52ded9449ebdea2ce7263c8038 and project 9192905d4b3645ddb643adaa1439e32d. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:07:49.186330 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-88aa3e05-128a-48b9-b0c6-46b3f10280d7 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.409014 Dec 15 14:07:49.187038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 309/609] 10.222.0.42 () {60 vars in 1157 bytes} [Wed Dec 15 14:07:48 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:49.238263 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2c4561d9-c15c-43bb-9057-b16570d755dd tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1710054114", "imageRef": "724ccf4b-ca04-4c3f-9711-3ed0dba92df1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1996515674", "networks": [{"uuid": "51882d30-5494-4c62-9682-a33d207550e7"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:49.291627 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-2c4561d9-c15c-43bb-9057-b16570d755dd tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] validate_networks() for [('51882d30-5494-4c62-9682-a33d207550e7', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:07:49.379975 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5b65518c-7a3b-4599-bc05-29fcbfb7b01f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:49.381062 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5b65518c-7a3b-4599-bc05-29fcbfb7b01f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:49.387350 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b65518c-7a3b-4599-bc05-29fcbfb7b01f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:49.387800 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b65518c-7a3b-4599-bc05-29fcbfb7b01f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:49.388594 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b65518c-7a3b-4599-bc05-29fcbfb7b01f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:49.389056 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b65518c-7a3b-4599-bc05-29fcbfb7b01f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:49.665472 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5b65518c-7a3b-4599-bc05-29fcbfb7b01f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:49.673558 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5b65518c-7a3b-4599-bc05-29fcbfb7b01f tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1506 microversion: 2.1 time: 0.297587 Dec 15 14:07:49.674290 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 310/610] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:49 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:07:49.678820 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-36eb504a-02ba-47c3-8a02-cb05eac8e16b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:49.679869 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-36eb504a-02ba-47c3-8a02-cb05eac8e16b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:49.686678 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36eb504a-02ba-47c3-8a02-cb05eac8e16b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:49.687216 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36eb504a-02ba-47c3-8a02-cb05eac8e16b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:49.688012 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36eb504a-02ba-47c3-8a02-cb05eac8e16b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:49.688450 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36eb504a-02ba-47c3-8a02-cb05eac8e16b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:49.802890 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-36eb504a-02ba-47c3-8a02-cb05eac8e16b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.127197 Dec 15 14:07:49.803552 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 311/611] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:49 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:49.808539 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5521a3f0-c79d-4d9c-9c86-74ed9e17f976 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:49.809547 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5521a3f0-c79d-4d9c-9c86-74ed9e17f976 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:49.816839 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5521a3f0-c79d-4d9c-9c86-74ed9e17f976 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:49.817295 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5521a3f0-c79d-4d9c-9c86-74ed9e17f976 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:49.818134 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5521a3f0-c79d-4d9c-9c86-74ed9e17f976 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:49.818773 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5521a3f0-c79d-4d9c-9c86-74ed9e17f976 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:49.885629 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-2c4561d9-c15c-43bb-9057-b16570d755dd tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:07:49.886093 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-2c4561d9-c15c-43bb-9057-b16570d755dd tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:07:49.886588 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-2c4561d9-c15c-43bb-9057-b16570d755dd tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:07:49.886998 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-2c4561d9-c15c-43bb-9057-b16570d755dd tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:07:49.887411 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-2c4561d9-c15c-43bb-9057-b16570d755dd tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:07:49.901954 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c4561d9-c15c-43bb-9057-b16570d755dd tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:49.903490 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c4561d9-c15c-43bb-9057-b16570d755dd tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:49.904478 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c4561d9-c15c-43bb-9057-b16570d755dd tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:49.904988 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c4561d9-c15c-43bb-9057-b16570d755dd tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:49.907455 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5521a3f0-c79d-4d9c-9c86-74ed9e17f976 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.102501 Dec 15 14:07:49.908488 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 312/612] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:49 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:49.916735 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-90f8149e-ff08-434c-b4df-db89de003a47 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:49.917529 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-90f8149e-ff08-434c-b4df-db89de003a47 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:49.923364 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-2c4561d9-c15c-43bb-9057-b16570d755dd tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Getting quotas for project 9192905d4b3645ddb643adaa1439e32d. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:07:49.925427 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90f8149e-ff08-434c-b4df-db89de003a47 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:49.925776 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90f8149e-ff08-434c-b4df-db89de003a47 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:49.926674 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90f8149e-ff08-434c-b4df-db89de003a47 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:49.927236 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90f8149e-ff08-434c-b4df-db89de003a47 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:49.927580 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-2c4561d9-c15c-43bb-9057-b16570d755dd tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Getting quotas for user 5e174c52ded9449ebdea2ce7263c8038 and project 9192905d4b3645ddb643adaa1439e32d. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:07:49.940038 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2c4561d9-c15c-43bb-9057-b16570d755dd tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:07:49.942260 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2c4561d9-c15c-43bb-9057-b16570d755dd tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='724ccf4b-ca04-4c3f-9711-3ed0dba92df1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:07:49.995076 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2c4561d9-c15c-43bb-9057-b16570d755dd tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760482 Dec 15 14:07:49.995735 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 301/613] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Dec 15 14:07:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:07:50.006329 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fc27b3b1-1310-405b-9878-9934a2172461 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:50.007155 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fc27b3b1-1310-405b-9878-9934a2172461 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:50.084457 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fc27b3b1-1310-405b-9878-9934a2172461 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:50.093102 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fc27b3b1-1310-405b-9878-9934a2172461 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 200 len: 1259 microversion: 2.1 time: 0.091112 Dec 15 14:07:50.094048 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 302/614] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:50 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 1259 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:07:50.201126 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90f8149e-ff08-434c-b4df-db89de003a47 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:50.214155 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-90f8149e-ff08-434c-b4df-db89de003a47 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1507 microversion: 2.1 time: 0.300891 Dec 15 14:07:50.215558 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 313/615] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:49 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1507 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:50.231236 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-06211d58-d491-4ac4-a67f-60421ef7012e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e7f7cf5-f022-4732-950c-08088a47aae0", "device": "/dev/sdb"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:50.233024 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-06211d58-d491-4ac4-a67f-60421ef7012e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:50.239543 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-06211d58-d491-4ac4-a67f-60421ef7012e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:50.240015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-06211d58-d491-4ac4-a67f-60421ef7012e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:50.240902 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-06211d58-d491-4ac4-a67f-60421ef7012e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:50.241332 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-06211d58-d491-4ac4-a67f-60421ef7012e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:50.376829 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-5fb9972c-2946-44b1-af94-a7dc63fad6a9 req-9c7de0b4-9ea3-494c-a410-0b54a0a264be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbed1ca6-db9b-4346-9edd-5047a3e302e7", "name": "network-vif-deleted", "tag": "0ac2210e-a283-4a63-80c5-bed03c1478de"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:50.378396 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:07:50.378396 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:07:50.386180 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-5fb9972c-2946-44b1-af94-a7dc63fad6a9 req-9c7de0b4-9ea3-494c-a410-0b54a0a264be service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:50.386907 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-5fb9972c-2946-44b1-af94-a7dc63fad6a9 req-9c7de0b4-9ea3-494c-a410-0b54a0a264be service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:50.400751 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-5fb9972c-2946-44b1-af94-a7dc63fad6a9 req-9c7de0b4-9ea3-494c-a410-0b54a0a264be service nova] Creating event network-vif-deleted:0ac2210e-a283-4a63-80c5-bed03c1478de for instance cbed1ca6-db9b-4346-9edd-5047a3e302e7 on hv-cinder-82182 Dec 15 14:07:50.408561 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-5fb9972c-2946-44b1-af94-a7dc63fad6a9 req-9c7de0b4-9ea3-494c-a410-0b54a0a264be service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035619 Dec 15 14:07:50.409243 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 314/616] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:07:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:07:50.602779 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-06211d58-d491-4ac4-a67f-60421ef7012e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "POST /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.375178 Dec 15 14:07:50.603443 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 303/617] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Dec 15 14:07:50 2021] POST /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f/os-volume_attachments => generated 194 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:07:50.691578 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-618b41af-e509-47b2-9750-ab71e18c2a6c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:50.692349 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-618b41af-e509-47b2-9750-ab71e18c2a6c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:50.698896 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-618b41af-e509-47b2-9750-ab71e18c2a6c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:50.699352 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-618b41af-e509-47b2-9750-ab71e18c2a6c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:50.700149 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-618b41af-e509-47b2-9750-ab71e18c2a6c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:50.700683 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-618b41af-e509-47b2-9750-ab71e18c2a6c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:50.735083 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-618b41af-e509-47b2-9750-ab71e18c2a6c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:50.735549 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-618b41af-e509-47b2-9750-ab71e18c2a6c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:50.735998 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-618b41af-e509-47b2-9750-ab71e18c2a6c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lazy-loading 'fault' on Instance uuid cbed1ca6-db9b-4346-9edd-5047a3e302e7 {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:07:50.788814 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-618b41af-e509-47b2-9750-ab71e18c2a6c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:50.797113 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-618b41af-e509-47b2-9750-ab71e18c2a6c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 200 len: 1311 microversion: 2.1 time: 0.110056 Dec 15 14:07:50.798013 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 315/618] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:50 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:50.816757 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-05c24ab6-dd89-4b6a-b42e-35ef161163b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:50.817840 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-05c24ab6-dd89-4b6a-b42e-35ef161163b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:50.825099 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05c24ab6-dd89-4b6a-b42e-35ef161163b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:50.825551 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05c24ab6-dd89-4b6a-b42e-35ef161163b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:50.826387 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05c24ab6-dd89-4b6a-b42e-35ef161163b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:50.827557 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05c24ab6-dd89-4b6a-b42e-35ef161163b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:50.919464 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-14db1650-697e-40ca-9267-f90fa6ebb904 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:50.920438 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-14db1650-697e-40ca-9267-f90fa6ebb904 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:50.926692 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-14db1650-697e-40ca-9267-f90fa6ebb904 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:50.927157 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-14db1650-697e-40ca-9267-f90fa6ebb904 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:50.927938 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-14db1650-697e-40ca-9267-f90fa6ebb904 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:50.928380 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-14db1650-697e-40ca-9267-f90fa6ebb904 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:50.940911 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-05c24ab6-dd89-4b6a-b42e-35ef161163b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 29061 microversion: 2.20 time: 0.129525 Dec 15 14:07:50.942064 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 304/619] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:50 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 29061 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:07:51.034881 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-14db1650-697e-40ca-9267-f90fa6ebb904 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 28919 microversion: 2.1 time: 0.119018 Dec 15 14:07:51.035539 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 316/620] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:50 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 28919 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:51.112881 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5f56127b-0980-42ac-8710-b8dca58d1287 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:51.114214 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5f56127b-0980-42ac-8710-b8dca58d1287 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:51.122844 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f56127b-0980-42ac-8710-b8dca58d1287 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:51.123667 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f56127b-0980-42ac-8710-b8dca58d1287 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:51.124646 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f56127b-0980-42ac-8710-b8dca58d1287 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:51.125083 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f56127b-0980-42ac-8710-b8dca58d1287 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:51.195315 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5f56127b-0980-42ac-8710-b8dca58d1287 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:51.203940 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5f56127b-0980-42ac-8710-b8dca58d1287 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 200 len: 1311 microversion: 2.1 time: 0.096489 Dec 15 14:07:51.204503 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 305/621] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:51 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:51.814823 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-74dea9dc-c1d9-4b96-a7e2-9a57f3387130 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:51.815517 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-74dea9dc-c1d9-4b96-a7e2-9a57f3387130 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: cbed1ca6-db9b-4346-9edd-5047a3e302e7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:51.823551 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74dea9dc-c1d9-4b96-a7e2-9a57f3387130 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:51.824038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74dea9dc-c1d9-4b96-a7e2-9a57f3387130 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:51.825152 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74dea9dc-c1d9-4b96-a7e2-9a57f3387130 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:51.825852 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74dea9dc-c1d9-4b96-a7e2-9a57f3387130 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:51.842650 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-74dea9dc-c1d9-4b96-a7e2-9a57f3387130 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] HTTP exception thrown: Instance cbed1ca6-db9b-4346-9edd-5047a3e302e7 could not be found. Dec 15 14:07:51.843390 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-74dea9dc-c1d9-4b96-a7e2-9a57f3387130 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Returning 404 to user: Instance cbed1ca6-db9b-4346-9edd-5047a3e302e7 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:07:51.844288 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-74dea9dc-c1d9-4b96-a7e2-9a57f3387130 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7" status: 404 len: 111 microversion: 2.1 time: 0.033875 Dec 15 14:07:51.845130 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 317/622] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:51 2021] GET /compute/v2.1/servers/cbed1ca6-db9b-4346-9edd-5047a3e302e7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:07:51.854895 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c89dd341-2e6a-4d5c-91e5-8d7b12827740 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:51.855707 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c89dd341-2e6a-4d5c-91e5-8d7b12827740 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:51.862809 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c89dd341-2e6a-4d5c-91e5-8d7b12827740 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:51.863425 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c89dd341-2e6a-4d5c-91e5-8d7b12827740 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:51.864335 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c89dd341-2e6a-4d5c-91e5-8d7b12827740 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:51.864874 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c89dd341-2e6a-4d5c-91e5-8d7b12827740 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:51.893868 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c89dd341-2e6a-4d5c-91e5-8d7b12827740 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:07:51.955404 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-30bd9ef4-ae75-4962-a188-35cd566c3dd4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:51.956789 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-30bd9ef4-ae75-4962-a188-35cd566c3dd4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:51.965914 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30bd9ef4-ae75-4962-a188-35cd566c3dd4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:51.966623 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30bd9ef4-ae75-4962-a188-35cd566c3dd4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:51.967952 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30bd9ef4-ae75-4962-a188-35cd566c3dd4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:51.968592 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30bd9ef4-ae75-4962-a188-35cd566c3dd4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:51.997263 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c89dd341-2e6a-4d5c-91e5-8d7b12827740 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 204 len: 0 microversion: 2.1 time: 0.147127 Dec 15 14:07:52.001401 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 306/623] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:07:51 2021] DELETE /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:07:52.007870 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f5595fe6-4006-4ac5-b885-4d7bcc648639 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:52.009915 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f5595fe6-4006-4ac5-b885-4d7bcc648639 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:52.017086 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5595fe6-4006-4ac5-b885-4d7bcc648639 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:52.017696 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5595fe6-4006-4ac5-b885-4d7bcc648639 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:52.018882 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5595fe6-4006-4ac5-b885-4d7bcc648639 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:52.019728 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5595fe6-4006-4ac5-b885-4d7bcc648639 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:52.260558 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f5595fe6-4006-4ac5-b885-4d7bcc648639 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:07:52.275255 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f5595fe6-4006-4ac5-b885-4d7bcc648639 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.271789 Dec 15 14:07:52.276561 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 307/624] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:07:52 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:07:52.282045 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a0ac6d1d-cdfc-4067-a3ff-3f9db44cf496 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:52.306153 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a0ac6d1d-cdfc-4067-a3ff-3f9db44cf496 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:07:52.333052 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a0ac6d1d-cdfc-4067-a3ff-3f9db44cf496 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:52.334037 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a0ac6d1d-cdfc-4067-a3ff-3f9db44cf496 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:07:52.335520 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a0ac6d1d-cdfc-4067-a3ff-3f9db44cf496 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:07:52.335824 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a0ac6d1d-cdfc-4067-a3ff-3f9db44cf496 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:10.760481 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-30bd9ef4-ae75-4962-a188-35cd566c3dd4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 36559 microversion: 2.20 time: 18.811508 Dec 15 14:08:10.761541 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 318/625] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:07:51 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 36559 bytes in 18814 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:08:10.766905 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c4b1352f-66fe-475c-8d7e-1eab5805cb27 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:10.767836 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c4b1352f-66fe-475c-8d7e-1eab5805cb27 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:10.777651 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4b1352f-66fe-475c-8d7e-1eab5805cb27 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:10.778338 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4b1352f-66fe-475c-8d7e-1eab5805cb27 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:10.779130 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4b1352f-66fe-475c-8d7e-1eab5805cb27 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:10.779901 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4b1352f-66fe-475c-8d7e-1eab5805cb27 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:10.833801 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a0ac6d1d-cdfc-4067-a3ff-3f9db44cf496 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 36448 microversion: 2.1 time: 18.555584 Dec 15 14:08:10.838336 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 308/626] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:07:52 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 36448 bytes in 18558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:08:10.840246 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-81c2c166-a64f-4efe-9780-2c0c60869e1d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:10.840926 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-81c2c166-a64f-4efe-9780-2c0c60869e1d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:10.848440 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81c2c166-a64f-4efe-9780-2c0c60869e1d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:10.848857 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81c2c166-a64f-4efe-9780-2c0c60869e1d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:10.849670 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81c2c166-a64f-4efe-9780-2c0c60869e1d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:10.850105 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81c2c166-a64f-4efe-9780-2c0c60869e1d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:11.155294 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c4b1352f-66fe-475c-8d7e-1eab5805cb27 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:11.163735 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c4b1352f-66fe-475c-8d7e-1eab5805cb27 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 200 len: 1359 microversion: 2.1 time: 0.400584 Dec 15 14:08:11.164437 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 319/627] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:10 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 1359 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:11.168844 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f9b08a2a-cbef-4203-bfd0-9e2586732e4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-817324066", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1666222908", "security_groups": [{"name": "tempest-secgroup-smoke-1047350202"}], "networks": [{"uuid": "59875c98-a85f-403b-bf99-1515a87bf051"}], "block_device_mapping_v2": [{"uuid": "c9d666a2-ad62-4591-bf10-8557071107a2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:11.193775 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-81c2c166-a64f-4efe-9780-2c0c60869e1d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:11.202669 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-81c2c166-a64f-4efe-9780-2c0c60869e1d tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.366105 Dec 15 14:08:11.212696 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 309/628] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:10 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:11.549225 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-f9b08a2a-cbef-4203-bfd0-9e2586732e4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] validate_networks() for [('59875c98-a85f-403b-bf99-1515a87bf051', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:08:11.774743 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2adea750-1021-498a-9b17-c5a52118483e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:11.775681 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2adea750-1021-498a-9b17-c5a52118483e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:11.785596 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2adea750-1021-498a-9b17-c5a52118483e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:11.785917 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2adea750-1021-498a-9b17-c5a52118483e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:11.786723 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2adea750-1021-498a-9b17-c5a52118483e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:11.787160 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2adea750-1021-498a-9b17-c5a52118483e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:11.890877 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2adea750-1021-498a-9b17-c5a52118483e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 37474 microversion: 2.20 time: 0.121934 Dec 15 14:08:11.892546 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 310/629] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:08:11 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 37474 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:08:11.898054 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3629915c-6a74-40f0-b407-a8eb3840b3cd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:11.899060 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3629915c-6a74-40f0-b407-a8eb3840b3cd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:11.906502 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3629915c-6a74-40f0-b407-a8eb3840b3cd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:11.906943 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3629915c-6a74-40f0-b407-a8eb3840b3cd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:11.907723 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3629915c-6a74-40f0-b407-a8eb3840b3cd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:11.908147 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3629915c-6a74-40f0-b407-a8eb3840b3cd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:12.011806 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3629915c-6a74-40f0-b407-a8eb3840b3cd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 37356 microversion: 2.1 time: 0.117421 Dec 15 14:08:12.012400 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 311/630] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:08:11 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 37356 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:08:12.089280 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-0bbda67d-e110-4590-8e4c-844ece24dcc9 req-706575bb-bca0-407e-8bad-17057564633b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30495aa3-75be-49a0-8151-5d522aca3b7e", "tag": "9ef918c4-0e02-4d7a-813c-c4bb79ce69bf"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:12.091335 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:08:12.091335 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:08:12.100882 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-0bbda67d-e110-4590-8e4c-844ece24dcc9 req-706575bb-bca0-407e-8bad-17057564633b service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:12.101323 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-0bbda67d-e110-4590-8e4c-844ece24dcc9 req-706575bb-bca0-407e-8bad-17057564633b service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:12.114562 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-0bbda67d-e110-4590-8e4c-844ece24dcc9 req-706575bb-bca0-407e-8bad-17057564633b service nova] Creating event network-changed:9ef918c4-0e02-4d7a-813c-c4bb79ce69bf for instance 30495aa3-75be-49a0-8151-5d522aca3b7e on hv-cinder-82182 Dec 15 14:08:12.130273 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-0bbda67d-e110-4590-8e4c-844ece24dcc9 req-706575bb-bca0-407e-8bad-17057564633b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044852 Dec 15 14:08:12.132530 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 312/631] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:08:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:08:12.181783 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-f9b08a2a-cbef-4203-bfd0-9e2586732e4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:08:12.182969 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-f9b08a2a-cbef-4203-bfd0-9e2586732e4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:08:12.183663 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-f9b08a2a-cbef-4203-bfd0-9e2586732e4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:08:12.183780 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e3d8e59e-f84f-486b-87a6-f8659328ed7f tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:12.184539 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-f9b08a2a-cbef-4203-bfd0-9e2586732e4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:08:12.185120 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e3d8e59e-f84f-486b-87a6-f8659328ed7f tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:12.185318 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-f9b08a2a-cbef-4203-bfd0-9e2586732e4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:08:12.194130 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e3d8e59e-f84f-486b-87a6-f8659328ed7f tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:12.195240 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e3d8e59e-f84f-486b-87a6-f8659328ed7f tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:12.196047 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e3d8e59e-f84f-486b-87a6-f8659328ed7f tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:12.196194 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9b08a2a-cbef-4203-bfd0-9e2586732e4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:12.196488 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e3d8e59e-f84f-486b-87a6-f8659328ed7f tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:12.198163 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9b08a2a-cbef-4203-bfd0-9e2586732e4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:12.199541 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9b08a2a-cbef-4203-bfd0-9e2586732e4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:12.200180 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9b08a2a-cbef-4203-bfd0-9e2586732e4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:12.223052 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-f9b08a2a-cbef-4203-bfd0-9e2586732e4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Getting quotas for project a91c6aedd2b540029697c563f45674ed. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:08:12.229365 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-f9b08a2a-cbef-4203-bfd0-9e2586732e4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Getting quotas for user ce494e335af643b18361d73fa6a13a3a and project a91c6aedd2b540029697c563f45674ed. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:08:12.287991 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f9b08a2a-cbef-4203-bfd0-9e2586732e4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:08:12.290209 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f9b08a2a-cbef-4203-bfd0-9e2586732e4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c9d666a2-ad62-4591-bf10-8557071107a2',volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:08:12.423290 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e3d8e59e-f84f-486b-87a6-f8659328ed7f tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:12.429184 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f9b08a2a-cbef-4203-bfd0-9e2586732e4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.263653 Dec 15 14:08:12.430110 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 320/632] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Dec 15 14:08:11 2021] POST /compute/v2.1/servers => generated 406 bytes in 1265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:08:12.435093 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8885d530-2ce3-4282-93c6-422223c8ff5e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:12.435974 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8885d530-2ce3-4282-93c6-422223c8ff5e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:12.443590 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8885d530-2ce3-4282-93c6-422223c8ff5e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:12.444343 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8885d530-2ce3-4282-93c6-422223c8ff5e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:12.445149 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8885d530-2ce3-4282-93c6-422223c8ff5e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:12.445577 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8885d530-2ce3-4282-93c6-422223c8ff5e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:12.448533 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e3d8e59e-f84f-486b-87a6-f8659328ed7f tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 200 len: 1359 microversion: 2.1 time: 0.270406 Dec 15 14:08:12.449164 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 313/633] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:12 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 1359 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:08:12.457148 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e82133e7-2201-48ea-8965-ce9fc1aea2c7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:12.458215 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e82133e7-2201-48ea-8965-ce9fc1aea2c7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:12.573785 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e82133e7-2201-48ea-8965-ce9fc1aea2c7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:12.580980 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e82133e7-2201-48ea-8965-ce9fc1aea2c7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1088 microversion: 2.1 time: 0.130268 Dec 15 14:08:12.582325 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 314/634] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:12 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1088 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:12.726458 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8885d530-2ce3-4282-93c6-422223c8ff5e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:12.738327 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8885d530-2ce3-4282-93c6-422223c8ff5e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.306524 Dec 15 14:08:12.740033 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 321/635] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:12 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:12.913922 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-54aaa527-af6e-4608-8d08-628deed8e1c6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:12.915575 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-54aaa527-af6e-4608-8d08-628deed8e1c6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:12.923375 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54aaa527-af6e-4608-8d08-628deed8e1c6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:12.923831 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54aaa527-af6e-4608-8d08-628deed8e1c6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:12.924649 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54aaa527-af6e-4608-8d08-628deed8e1c6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:12.925434 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54aaa527-af6e-4608-8d08-628deed8e1c6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:13.025051 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f8452933-1be9-48da-a379-3bc78fa66d27 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:13.026139 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f8452933-1be9-48da-a379-3bc78fa66d27 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:13.033000 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8452933-1be9-48da-a379-3bc78fa66d27 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:13.033460 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8452933-1be9-48da-a379-3bc78fa66d27 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:13.034289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8452933-1be9-48da-a379-3bc78fa66d27 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:13.034781 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8452933-1be9-48da-a379-3bc78fa66d27 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:13.346712 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f8452933-1be9-48da-a379-3bc78fa66d27 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 38443 microversion: 2.1 time: 0.325575 Dec 15 14:08:13.347506 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 322/636] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:08:13 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 38443 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:08:13.401839 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-54aaa527-af6e-4608-8d08-628deed8e1c6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 38597 microversion: 2.20 time: 0.501459 Dec 15 14:08:13.402448 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 315/637] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:08:12 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 38597 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:08:13.467947 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c2805e4d-6ff4-4223-9d62-5f5fb897114f tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:13.468973 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c2805e4d-6ff4-4223-9d62-5f5fb897114f tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:13.479382 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c2805e4d-6ff4-4223-9d62-5f5fb897114f tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:13.479917 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c2805e4d-6ff4-4223-9d62-5f5fb897114f tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:13.481195 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c2805e4d-6ff4-4223-9d62-5f5fb897114f tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:13.481945 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c2805e4d-6ff4-4223-9d62-5f5fb897114f tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:13.598582 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-181d2eed-1033-48ab-9250-01d596b95d77 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:13.599492 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-181d2eed-1033-48ab-9250-01d596b95d77 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:13.613888 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-181d2eed-1033-48ab-9250-01d596b95d77 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:13.614331 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-181d2eed-1033-48ab-9250-01d596b95d77 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:13.615351 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-181d2eed-1033-48ab-9250-01d596b95d77 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:13.615647 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-181d2eed-1033-48ab-9250-01d596b95d77 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:13.644495 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c2805e4d-6ff4-4223-9d62-5f5fb897114f tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:13.652761 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c2805e4d-6ff4-4223-9d62-5f5fb897114f tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 200 len: 1359 microversion: 2.1 time: 0.189564 Dec 15 14:08:13.653282 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 323/638] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:13 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:13.688618 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-181d2eed-1033-48ab-9250-01d596b95d77 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:13.696667 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-181d2eed-1033-48ab-9250-01d596b95d77 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1186 microversion: 2.1 time: 0.102811 Dec 15 14:08:13.697426 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 316/639] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:13 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1186 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:13.757555 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c879ca06-000c-44ba-93b9-b72c8dadaf26 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:13.758162 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c879ca06-000c-44ba-93b9-b72c8dadaf26 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:13.770768 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c879ca06-000c-44ba-93b9-b72c8dadaf26 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:13.771225 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c879ca06-000c-44ba-93b9-b72c8dadaf26 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:13.773187 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c879ca06-000c-44ba-93b9-b72c8dadaf26 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:13.773187 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c879ca06-000c-44ba-93b9-b72c8dadaf26 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:13.994927 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c879ca06-000c-44ba-93b9-b72c8dadaf26 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:14.004172 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c879ca06-000c-44ba-93b9-b72c8dadaf26 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.250951 Dec 15 14:08:14.004888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 324/640] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:13 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:14.359033 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e7fa9bc4-4c1d-4ef1-9889-832c4baf3a5c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:14.360103 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e7fa9bc4-4c1d-4ef1-9889-832c4baf3a5c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:14.367318 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e7fa9bc4-4c1d-4ef1-9889-832c4baf3a5c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:14.367770 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e7fa9bc4-4c1d-4ef1-9889-832c4baf3a5c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:14.368575 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e7fa9bc4-4c1d-4ef1-9889-832c4baf3a5c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:14.369010 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e7fa9bc4-4c1d-4ef1-9889-832c4baf3a5c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:14.414460 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b8e7f0f6-1269-4060-9fa6-f5ea42b03717 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:14.415376 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b8e7f0f6-1269-4060-9fa6-f5ea42b03717 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:14.422113 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8e7f0f6-1269-4060-9fa6-f5ea42b03717 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:14.422552 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8e7f0f6-1269-4060-9fa6-f5ea42b03717 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:14.423460 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8e7f0f6-1269-4060-9fa6-f5ea42b03717 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:14.423841 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8e7f0f6-1269-4060-9fa6-f5ea42b03717 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:14.502143 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e7fa9bc4-4c1d-4ef1-9889-832c4baf3a5c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 38443 microversion: 2.1 time: 0.146660 Dec 15 14:08:14.506594 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 317/641] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:08:14 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 38443 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:08:14.526871 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b8e7f0f6-1269-4060-9fa6-f5ea42b03717 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 38597 microversion: 2.20 time: 0.116057 Dec 15 14:08:14.528184 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 325/642] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:08:14 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 38597 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:08:14.671127 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3a67b8ad-ac8e-44a4-8933-e94fcda38cd8 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:14.671848 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3a67b8ad-ac8e-44a4-8933-e94fcda38cd8 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:14.679434 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3a67b8ad-ac8e-44a4-8933-e94fcda38cd8 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:14.679876 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3a67b8ad-ac8e-44a4-8933-e94fcda38cd8 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:14.680990 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3a67b8ad-ac8e-44a4-8933-e94fcda38cd8 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:14.681450 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3a67b8ad-ac8e-44a4-8933-e94fcda38cd8 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:14.714439 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7002ae6e-c6cb-4813-80f1-5a2421a56437 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:14.715927 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7002ae6e-c6cb-4813-80f1-5a2421a56437 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:14.723905 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7002ae6e-c6cb-4813-80f1-5a2421a56437 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:14.724460 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7002ae6e-c6cb-4813-80f1-5a2421a56437 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:14.725646 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7002ae6e-c6cb-4813-80f1-5a2421a56437 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:14.726325 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7002ae6e-c6cb-4813-80f1-5a2421a56437 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:15.006374 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3a67b8ad-ac8e-44a4-8933-e94fcda38cd8 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:15.020051 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3a67b8ad-ac8e-44a4-8933-e94fcda38cd8 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 200 len: 1359 microversion: 2.1 time: 0.348382 Dec 15 14:08:15.020051 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 318/643] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:14 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 1359 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:15.024253 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c56b5360-d10f-465e-a60c-2f3db0bfd2b8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:15.025197 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c56b5360-d10f-465e-a60c-2f3db0bfd2b8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:15.032155 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c56b5360-d10f-465e-a60c-2f3db0bfd2b8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:15.032609 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c56b5360-d10f-465e-a60c-2f3db0bfd2b8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:15.033419 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c56b5360-d10f-465e-a60c-2f3db0bfd2b8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:15.033896 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c56b5360-d10f-465e-a60c-2f3db0bfd2b8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:15.055571 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7002ae6e-c6cb-4813-80f1-5a2421a56437 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:15.063334 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7002ae6e-c6cb-4813-80f1-5a2421a56437 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1272 microversion: 2.1 time: 0.353047 Dec 15 14:08:15.064186 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 326/644] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:14 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1272 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:08:15.491466 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c56b5360-d10f-465e-a60c-2f3db0bfd2b8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:15.500347 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c56b5360-d10f-465e-a60c-2f3db0bfd2b8 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.480891 Dec 15 14:08:15.509993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 319/645] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:15 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:15.515138 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e46151dc-f144-4798-ba23-ccfff2fe5f29 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:15.516279 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e46151dc-f144-4798-ba23-ccfff2fe5f29 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:15.523861 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e46151dc-f144-4798-ba23-ccfff2fe5f29 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:15.524279 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e46151dc-f144-4798-ba23-ccfff2fe5f29 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:15.525293 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e46151dc-f144-4798-ba23-ccfff2fe5f29 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:15.525791 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e46151dc-f144-4798-ba23-ccfff2fe5f29 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:15.540432 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b5825284-89f2-47d7-9475-736bce5346b0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:15.541453 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b5825284-89f2-47d7-9475-736bce5346b0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:15.547778 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5825284-89f2-47d7-9475-736bce5346b0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:15.548215 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5825284-89f2-47d7-9475-736bce5346b0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:15.549320 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5825284-89f2-47d7-9475-736bce5346b0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:15.549715 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5825284-89f2-47d7-9475-736bce5346b0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:15.622255 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e46151dc-f144-4798-ba23-ccfff2fe5f29 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 38443 microversion: 2.1 time: 0.110768 Dec 15 14:08:15.623885 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 327/646] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:08:15 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 38443 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:08:15.646920 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b5825284-89f2-47d7-9475-736bce5346b0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 38597 microversion: 2.20 time: 0.111193 Dec 15 14:08:15.651373 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 320/647] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:08:15 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 38597 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:08:15.691795 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-b1aa00e7-fbe8-476e-a243-050f5e326fd4 req-ad8d0e89-38f2-4c3b-93e5-dbb973b68561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12be41af-387a-4090-93dd-d26d8e97bf45", "tag": "ffe19195-444e-423e-ac6a-9120626e5ae8"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:15.693659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:08:15.693659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:08:15.704480 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-b1aa00e7-fbe8-476e-a243-050f5e326fd4 req-ad8d0e89-38f2-4c3b-93e5-dbb973b68561 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:15.709706 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-b1aa00e7-fbe8-476e-a243-050f5e326fd4 req-ad8d0e89-38f2-4c3b-93e5-dbb973b68561 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:15.722919 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-b1aa00e7-fbe8-476e-a243-050f5e326fd4 req-ad8d0e89-38f2-4c3b-93e5-dbb973b68561 service nova] Creating event network-changed:ffe19195-444e-423e-ac6a-9120626e5ae8 for instance 12be41af-387a-4090-93dd-d26d8e97bf45 on hv-cinder-82182 Dec 15 14:08:15.739507 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-b1aa00e7-fbe8-476e-a243-050f5e326fd4 req-ad8d0e89-38f2-4c3b-93e5-dbb973b68561 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053972 Dec 15 14:08:15.740113 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 328/648] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:08:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:08:16.038697 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fc4ee048-5612-425c-b5ff-0e6a945aa8cb tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:16.039412 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fc4ee048-5612-425c-b5ff-0e6a945aa8cb tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:16.046838 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc4ee048-5612-425c-b5ff-0e6a945aa8cb tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:16.047301 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc4ee048-5612-425c-b5ff-0e6a945aa8cb tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:16.048336 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc4ee048-5612-425c-b5ff-0e6a945aa8cb tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:16.048526 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc4ee048-5612-425c-b5ff-0e6a945aa8cb tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:16.081508 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-48ffa2f0-40c9-40d9-8319-f8b7f1b46265 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:16.082747 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-48ffa2f0-40c9-40d9-8319-f8b7f1b46265 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:16.089167 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-48ffa2f0-40c9-40d9-8319-f8b7f1b46265 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:16.089628 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-48ffa2f0-40c9-40d9-8319-f8b7f1b46265 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:16.090452 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-48ffa2f0-40c9-40d9-8319-f8b7f1b46265 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:16.090885 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-48ffa2f0-40c9-40d9-8319-f8b7f1b46265 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:16.334195 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fc4ee048-5612-425c-b5ff-0e6a945aa8cb tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:16.341489 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fc4ee048-5612-425c-b5ff-0e6a945aa8cb tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 200 len: 1359 microversion: 2.1 time: 0.306948 Dec 15 14:08:16.342298 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 321/649] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:16 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 1359 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:16.344884 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-48ffa2f0-40c9-40d9-8319-f8b7f1b46265 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:16.353831 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-48ffa2f0-40c9-40d9-8319-f8b7f1b46265 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1272 microversion: 2.1 time: 0.277126 Dec 15 14:08:16.354407 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 329/650] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:16 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1272 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:08:16.519562 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-779c10f1-2bf0-4823-b417-f5ef9c9243b4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:16.520466 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-779c10f1-2bf0-4823-b417-f5ef9c9243b4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:16.526734 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-779c10f1-2bf0-4823-b417-f5ef9c9243b4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:16.527436 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-779c10f1-2bf0-4823-b417-f5ef9c9243b4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:16.528462 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-779c10f1-2bf0-4823-b417-f5ef9c9243b4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:16.529061 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-779c10f1-2bf0-4823-b417-f5ef9c9243b4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:16.646594 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1077e7b6-97af-4f62-be0e-7e370c6bedf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:16.647618 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1077e7b6-97af-4f62-be0e-7e370c6bedf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:16.660082 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1077e7b6-97af-4f62-be0e-7e370c6bedf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:16.661533 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1077e7b6-97af-4f62-be0e-7e370c6bedf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:16.662701 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1077e7b6-97af-4f62-be0e-7e370c6bedf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:16.663305 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1077e7b6-97af-4f62-be0e-7e370c6bedf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:16.762627 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-779c10f1-2bf0-4823-b417-f5ef9c9243b4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:16.770992 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-779c10f1-2bf0-4823-b417-f5ef9c9243b4 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.255286 Dec 15 14:08:16.771587 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 322/651] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:16 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:08:16.776578 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d7e7f8ca-d67f-4a1c-a091-29b6b13f0fb0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:16.777531 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d7e7f8ca-d67f-4a1c-a091-29b6b13f0fb0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:16.785118 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d7e7f8ca-d67f-4a1c-a091-29b6b13f0fb0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:16.785416 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d7e7f8ca-d67f-4a1c-a091-29b6b13f0fb0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:16.786289 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d7e7f8ca-d67f-4a1c-a091-29b6b13f0fb0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:16.787189 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d7e7f8ca-d67f-4a1c-a091-29b6b13f0fb0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:16.792100 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1077e7b6-97af-4f62-be0e-7e370c6bedf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 38567 microversion: 2.1 time: 0.159532 Dec 15 14:08:16.793931 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 330/652] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:08:16 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 38567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:08:16.886607 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d7e7f8ca-d67f-4a1c-a091-29b6b13f0fb0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 200 len: 38738 microversion: 2.20 time: 0.113222 Dec 15 14:08:16.887623 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 323/653] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:08:16 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 38738 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:08:16.898729 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-efe747c6-3cdf-4bc2-822b-d2df742edb57 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:16.899346 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-efe747c6-3cdf-4bc2-822b-d2df742edb57 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:16.906596 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-efe747c6-3cdf-4bc2-822b-d2df742edb57 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:16.907043 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-efe747c6-3cdf-4bc2-822b-d2df742edb57 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:16.907827 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-efe747c6-3cdf-4bc2-822b-d2df742edb57 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:16.908263 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-efe747c6-3cdf-4bc2-822b-d2df742edb57 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:16.933081 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-efe747c6-3cdf-4bc2-822b-d2df742edb57 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/ips" status: 200 len: 152 microversion: 2.20 time: 0.038558 Dec 15 14:08:16.933663 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 331/654] 10.222.0.42 () {60 vars in 1288 bytes} [Wed Dec 15 14:08:16 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:08:17.360583 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f1328b68-20eb-4129-92c6-d7ce42a95528 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:17.361300 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f1328b68-20eb-4129-92c6-d7ce42a95528 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:17.368795 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1328b68-20eb-4129-92c6-d7ce42a95528 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:17.369234 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1328b68-20eb-4129-92c6-d7ce42a95528 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:17.370050 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1328b68-20eb-4129-92c6-d7ce42a95528 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:17.370410 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b1ee973e-4059-47c1-a1a6-ba22a472b888 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:17.370561 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1328b68-20eb-4129-92c6-d7ce42a95528 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:17.371211 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b1ee973e-4059-47c1-a1a6-ba22a472b888 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:17.377720 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1ee973e-4059-47c1-a1a6-ba22a472b888 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:17.378399 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1ee973e-4059-47c1-a1a6-ba22a472b888 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:17.379252 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1ee973e-4059-47c1-a1a6-ba22a472b888 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:17.379690 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1ee973e-4059-47c1-a1a6-ba22a472b888 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:17.583027 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b1ee973e-4059-47c1-a1a6-ba22a472b888 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:17.587190 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f1328b68-20eb-4129-92c6-d7ce42a95528 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:17.591602 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b1ee973e-4059-47c1-a1a6-ba22a472b888 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1272 microversion: 2.1 time: 0.224730 Dec 15 14:08:17.592556 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 332/655] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:17 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:08:17.601988 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f1328b68-20eb-4129-92c6-d7ce42a95528 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 200 len: 1359 microversion: 2.1 time: 0.245914 Dec 15 14:08:17.602942 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 324/656] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:17 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:17.791334 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0fd2fd85-1deb-49d9-8348-7cfe77e8537e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:17.792439 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0fd2fd85-1deb-49d9-8348-7cfe77e8537e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:17.802596 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fd2fd85-1deb-49d9-8348-7cfe77e8537e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:17.803314 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fd2fd85-1deb-49d9-8348-7cfe77e8537e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:17.804485 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fd2fd85-1deb-49d9-8348-7cfe77e8537e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:17.805183 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fd2fd85-1deb-49d9-8348-7cfe77e8537e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:17.807962 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-baddb5f2-1772-4204-9e8f-1b7bd1f4b90d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:17.809433 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-baddb5f2-1772-4204-9e8f-1b7bd1f4b90d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:17.818647 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-baddb5f2-1772-4204-9e8f-1b7bd1f4b90d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:17.819081 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-baddb5f2-1772-4204-9e8f-1b7bd1f4b90d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:17.819909 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-baddb5f2-1772-4204-9e8f-1b7bd1f4b90d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:17.820334 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-baddb5f2-1772-4204-9e8f-1b7bd1f4b90d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:17.989061 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-baddb5f2-1772-4204-9e8f-1b7bd1f4b90d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action" status: 200 len: 38574 microversion: 2.1 time: 0.187045 Dec 15 14:08:17.989786 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 325/657] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:08:17 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/action => generated 38574 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:08:17.994215 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0fd2fd85-1deb-49d9-8348-7cfe77e8537e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:18.000624 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d641e0d6-70cf-424e-8450-f630affca6af tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:18.001209 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d641e0d6-70cf-424e-8450-f630affca6af tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:18.002323 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0fd2fd85-1deb-49d9-8348-7cfe77e8537e tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1521 microversion: 2.1 time: 0.217011 Dec 15 14:08:18.003287 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 333/658] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:17 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:18.008642 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d641e0d6-70cf-424e-8450-f630affca6af tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:18.009088 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d641e0d6-70cf-424e-8450-f630affca6af tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:18.009942 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d641e0d6-70cf-424e-8450-f630affca6af tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:18.010375 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d641e0d6-70cf-424e-8450-f630affca6af tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:18.036830 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d641e0d6-70cf-424e-8450-f630affca6af tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/ips" status: 200 len: 144 microversion: 2.1 time: 0.040432 Dec 15 14:08:18.037414 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 326/659] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Dec 15 14:08:17 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/ips => generated 144 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:08:18.484578 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-c7b90abf-7059-4803-b316-954d3cc9fade req-7f8c901e-772d-4312-984b-f5c69461d588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfccdaf0-2b79-4ace-a816-8c76eba7f48b", "name": "network-vif-deleted", "tag": "c6825246-0c77-4125-b93c-02f824de479b"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:18.486534 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:08:18.486534 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:08:18.493665 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-c7b90abf-7059-4803-b316-954d3cc9fade req-7f8c901e-772d-4312-984b-f5c69461d588 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:18.494113 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-c7b90abf-7059-4803-b316-954d3cc9fade req-7f8c901e-772d-4312-984b-f5c69461d588 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:18.506371 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-c7b90abf-7059-4803-b316-954d3cc9fade req-7f8c901e-772d-4312-984b-f5c69461d588 service nova] Creating event network-vif-deleted:c6825246-0c77-4125-b93c-02f824de479b for instance bfccdaf0-2b79-4ace-a816-8c76eba7f48b on hv-cinder-82182 Dec 15 14:08:18.510857 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-c7b90abf-7059-4803-b316-954d3cc9fade req-7f8c901e-772d-4312-984b-f5c69461d588 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030755 Dec 15 14:08:18.511515 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 334/660] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:08:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:08:18.610338 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dfb1cb03-3849-49dd-8e6c-906f39b9b318 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:18.610941 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dfb1cb03-3849-49dd-8e6c-906f39b9b318 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:18.618314 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dfb1cb03-3849-49dd-8e6c-906f39b9b318 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:18.618781 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dfb1cb03-3849-49dd-8e6c-906f39b9b318 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:18.619575 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dfb1cb03-3849-49dd-8e6c-906f39b9b318 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:18.620008 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dfb1cb03-3849-49dd-8e6c-906f39b9b318 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:18.620443 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8376c631-e3fb-47ff-af74-2710b33eac89 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:18.621151 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8376c631-e3fb-47ff-af74-2710b33eac89 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:18.628821 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8376c631-e3fb-47ff-af74-2710b33eac89 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:18.629636 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8376c631-e3fb-47ff-af74-2710b33eac89 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:18.630744 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8376c631-e3fb-47ff-af74-2710b33eac89 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:18.631412 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8376c631-e3fb-47ff-af74-2710b33eac89 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:18.784745 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dfb1cb03-3849-49dd-8e6c-906f39b9b318 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:18.793427 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dfb1cb03-3849-49dd-8e6c-906f39b9b318 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1272 microversion: 2.1 time: 0.186943 Dec 15 14:08:18.794348 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 327/661] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:18 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:18.951696 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8376c631-e3fb-47ff-af74-2710b33eac89 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:18.959689 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8376c631-e3fb-47ff-af74-2710b33eac89 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 200 len: 1359 microversion: 2.1 time: 0.343925 Dec 15 14:08:18.960272 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 335/662] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:18 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 1359 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:19.019731 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-81cb0551-1046-4fb6-b396-b8899cc5f5dd tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:19.020353 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-81cb0551-1046-4fb6-b396-b8899cc5f5dd tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:19.027208 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81cb0551-1046-4fb6-b396-b8899cc5f5dd tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:19.027667 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81cb0551-1046-4fb6-b396-b8899cc5f5dd tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:19.028476 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81cb0551-1046-4fb6-b396-b8899cc5f5dd tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:19.028917 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81cb0551-1046-4fb6-b396-b8899cc5f5dd tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:19.061642 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81cb0551-1046-4fb6-b396-b8899cc5f5dd tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:19.062126 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81cb0551-1046-4fb6-b396-b8899cc5f5dd tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:19.062573 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-81cb0551-1046-4fb6-b396-b8899cc5f5dd tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lazy-loading 'fault' on Instance uuid bfccdaf0-2b79-4ace-a816-8c76eba7f48b {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:08:19.105160 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-81cb0551-1046-4fb6-b396-b8899cc5f5dd tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:19.113382 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-81cb0551-1046-4fb6-b396-b8899cc5f5dd tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1312 microversion: 2.1 time: 0.097480 Dec 15 14:08:19.114002 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 328/663] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:19 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:19.289239 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-15c1741c-c010-44aa-a0b1-cd687a458e1f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:19.289814 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-15c1741c-c010-44aa-a0b1-cd687a458e1f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:19.296427 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15c1741c-c010-44aa-a0b1-cd687a458e1f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:19.296884 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15c1741c-c010-44aa-a0b1-cd687a458e1f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:19.297697 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15c1741c-c010-44aa-a0b1-cd687a458e1f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:19.298139 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15c1741c-c010-44aa-a0b1-cd687a458e1f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:19.322796 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-15c1741c-c010-44aa-a0b1-cd687a458e1f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lazy-loading 'flavor' on Instance uuid fcc65306-f419-4eac-97a2-407c5d6744da {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:08:19.602938 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-15c1741c-c010-44aa-a0b1-cd687a458e1f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 202 len: 0 microversion: 2.20 time: 0.317371 Dec 15 14:08:19.603581 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 336/664] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:08:19 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:08:19.612209 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1c8f7672-feaa-4229-9436-d162421b988f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:19.612828 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1c8f7672-feaa-4229-9436-d162421b988f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:19.619523 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c8f7672-feaa-4229-9436-d162421b988f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:19.619979 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c8f7672-feaa-4229-9436-d162421b988f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:19.620786 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c8f7672-feaa-4229-9436-d162421b988f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:19.621219 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c8f7672-feaa-4229-9436-d162421b988f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:19.775545 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1c8f7672-feaa-4229-9436-d162421b988f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:19.783674 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1c8f7672-feaa-4229-9436-d162421b988f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:19.785167 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1c8f7672-feaa-4229-9436-d162421b988f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:19.786532 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1c8f7672-feaa-4229-9436-d162421b988f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1722 microversion: 2.20 time: 0.178092 Dec 15 14:08:19.787118 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 329/665] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:19 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:19.811945 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f20454a2-3801-44f4-b233-dae09a5b709e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:19.812646 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f20454a2-3801-44f4-b233-dae09a5b709e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:19.820251 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f20454a2-3801-44f4-b233-dae09a5b709e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:19.820695 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f20454a2-3801-44f4-b233-dae09a5b709e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:19.821477 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f20454a2-3801-44f4-b233-dae09a5b709e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:19.821973 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f20454a2-3801-44f4-b233-dae09a5b709e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:19.966551 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f20454a2-3801-44f4-b233-dae09a5b709e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:19.976891 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f20454a2-3801-44f4-b233-dae09a5b709e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.168712 Dec 15 14:08:19.977452 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 337/666] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:19 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:19.982015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9d97cef1-cfec-4cb6-a45c-96f3e5ea07fc tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:19.982636 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9d97cef1-cfec-4cb6-a45c-96f3e5ea07fc tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:19.989054 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d97cef1-cfec-4cb6-a45c-96f3e5ea07fc tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:19.989555 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d97cef1-cfec-4cb6-a45c-96f3e5ea07fc tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:19.990384 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d97cef1-cfec-4cb6-a45c-96f3e5ea07fc tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:19.990809 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d97cef1-cfec-4cb6-a45c-96f3e5ea07fc tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:20.130518 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-894296bc-d443-4fad-83a5-f37369c1a071 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:20.131126 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-894296bc-d443-4fad-83a5-f37369c1a071 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:20.134323 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9d97cef1-cfec-4cb6-a45c-96f3e5ea07fc tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:20.139410 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-894296bc-d443-4fad-83a5-f37369c1a071 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:20.140074 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-894296bc-d443-4fad-83a5-f37369c1a071 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:20.141208 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-894296bc-d443-4fad-83a5-f37369c1a071 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:20.141767 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-894296bc-d443-4fad-83a5-f37369c1a071 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:20.145179 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9d97cef1-cfec-4cb6-a45c-96f3e5ea07fc tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 200 len: 1359 microversion: 2.1 time: 0.166710 Dec 15 14:08:20.146807 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 330/667] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:19 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:20.174689 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-894296bc-d443-4fad-83a5-f37369c1a071 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:20.175133 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-894296bc-d443-4fad-83a5-f37369c1a071 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:20.175577 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-894296bc-d443-4fad-83a5-f37369c1a071 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lazy-loading 'fault' on Instance uuid bfccdaf0-2b79-4ace-a816-8c76eba7f48b {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:08:20.227036 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-894296bc-d443-4fad-83a5-f37369c1a071 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:20.234936 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-894296bc-d443-4fad-83a5-f37369c1a071 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1312 microversion: 2.1 time: 0.108368 Dec 15 14:08:20.235539 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 338/668] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:20 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:20.795562 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-5e8c3548-84f4-4886-ae0f-1d4780d8d035 req-8b508d32-5591-4e6b-b20f-dddc96e4bdb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30495aa3-75be-49a0-8151-5d522aca3b7e", "name": "network-vif-plugged", "status": "completed", "tag": "9ef918c4-0e02-4d7a-813c-c4bb79ce69bf"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:20.797231 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:08:20.797231 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:08:20.804905 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-5e8c3548-84f4-4886-ae0f-1d4780d8d035 req-8b508d32-5591-4e6b-b20f-dddc96e4bdb6 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:20.805356 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-5e8c3548-84f4-4886-ae0f-1d4780d8d035 req-8b508d32-5591-4e6b-b20f-dddc96e4bdb6 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:20.807088 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bd1b3768-902f-472c-a03d-fc2b87927023 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:20.807878 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bd1b3768-902f-472c-a03d-fc2b87927023 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:20.815054 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bd1b3768-902f-472c-a03d-fc2b87927023 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:20.815842 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bd1b3768-902f-472c-a03d-fc2b87927023 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:20.816632 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bd1b3768-902f-472c-a03d-fc2b87927023 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:20.817067 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bd1b3768-902f-472c-a03d-fc2b87927023 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:20.817190 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-5e8c3548-84f4-4886-ae0f-1d4780d8d035 req-8b508d32-5591-4e6b-b20f-dddc96e4bdb6 service nova] Creating event network-vif-plugged:9ef918c4-0e02-4d7a-813c-c4bb79ce69bf for instance 30495aa3-75be-49a0-8151-5d522aca3b7e on hv-cinder-82182 Dec 15 14:08:20.822188 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-5e8c3548-84f4-4886-ae0f-1d4780d8d035 req-8b508d32-5591-4e6b-b20f-dddc96e4bdb6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030267 Dec 15 14:08:20.822791 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 331/669] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:08:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:08:20.958595 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bd1b3768-902f-472c-a03d-fc2b87927023 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:20.967151 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bd1b3768-902f-472c-a03d-fc2b87927023 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:20.968647 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bd1b3768-902f-472c-a03d-fc2b87927023 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:20.969853 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bd1b3768-902f-472c-a03d-fc2b87927023 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1722 microversion: 2.20 time: 0.166633 Dec 15 14:08:20.970420 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 339/670] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:20 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:20.995059 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d8282e8a-64c9-474c-967b-796bd0da4d05 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:20.995753 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d8282e8a-64c9-474c-967b-796bd0da4d05 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:21.002741 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d8282e8a-64c9-474c-967b-796bd0da4d05 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:21.003196 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d8282e8a-64c9-474c-967b-796bd0da4d05 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:21.004020 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d8282e8a-64c9-474c-967b-796bd0da4d05 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:21.004456 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d8282e8a-64c9-474c-967b-796bd0da4d05 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:21.162983 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-87429b48-553f-4c28-8c96-870ea03fa352 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:21.163591 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-87429b48-553f-4c28-8c96-870ea03fa352 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:21.169815 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87429b48-553f-4c28-8c96-870ea03fa352 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:21.170265 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87429b48-553f-4c28-8c96-870ea03fa352 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:21.171048 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87429b48-553f-4c28-8c96-870ea03fa352 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:21.171479 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87429b48-553f-4c28-8c96-870ea03fa352 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:21.198162 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d8282e8a-64c9-474c-967b-796bd0da4d05 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:21.205698 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d8282e8a-64c9-474c-967b-796bd0da4d05 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.214774 Dec 15 14:08:21.206332 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 332/671] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:20 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:21.252678 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b57ac695-b3ed-464a-bc77-0385ffa002ac tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:21.253320 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b57ac695-b3ed-464a-bc77-0385ffa002ac tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:21.260372 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b57ac695-b3ed-464a-bc77-0385ffa002ac tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:21.260811 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b57ac695-b3ed-464a-bc77-0385ffa002ac tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:21.261591 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b57ac695-b3ed-464a-bc77-0385ffa002ac tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:21.262048 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b57ac695-b3ed-464a-bc77-0385ffa002ac tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:21.296449 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b57ac695-b3ed-464a-bc77-0385ffa002ac tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:21.296790 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b57ac695-b3ed-464a-bc77-0385ffa002ac tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:21.297275 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-b57ac695-b3ed-464a-bc77-0385ffa002ac tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lazy-loading 'fault' on Instance uuid bfccdaf0-2b79-4ace-a816-8c76eba7f48b {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:08:21.311273 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-87429b48-553f-4c28-8c96-870ea03fa352 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:21.319395 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-87429b48-553f-4c28-8c96-870ea03fa352 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 200 len: 1359 microversion: 2.1 time: 0.159979 Dec 15 14:08:21.320081 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 340/672] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:21 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:21.346603 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b57ac695-b3ed-464a-bc77-0385ffa002ac tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:21.355153 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b57ac695-b3ed-464a-bc77-0385ffa002ac tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1312 microversion: 2.1 time: 0.106419 Dec 15 14:08:21.355737 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 333/673] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:21 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:21.994012 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5a2edfef-b739-43c4-bfad-5f3f09c2c3f0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:21.995004 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5a2edfef-b739-43c4-bfad-5f3f09c2c3f0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:22.006157 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a2edfef-b739-43c4-bfad-5f3f09c2c3f0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:22.006907 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a2edfef-b739-43c4-bfad-5f3f09c2c3f0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:22.008259 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a2edfef-b739-43c4-bfad-5f3f09c2c3f0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:22.008989 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a2edfef-b739-43c4-bfad-5f3f09c2c3f0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:22.159765 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5a2edfef-b739-43c4-bfad-5f3f09c2c3f0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:22.168631 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5a2edfef-b739-43c4-bfad-5f3f09c2c3f0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:22.170154 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5a2edfef-b739-43c4-bfad-5f3f09c2c3f0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:22.171320 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5a2edfef-b739-43c4-bfad-5f3f09c2c3f0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1722 microversion: 2.20 time: 0.184409 Dec 15 14:08:22.171916 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 341/674] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:21 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:22.223788 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fd204dac-7c27-4568-afa3-d79e0888b8a2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:22.224597 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fd204dac-7c27-4568-afa3-d79e0888b8a2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:22.232205 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd204dac-7c27-4568-afa3-d79e0888b8a2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:22.232720 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd204dac-7c27-4568-afa3-d79e0888b8a2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:22.233667 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd204dac-7c27-4568-afa3-d79e0888b8a2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:22.234166 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd204dac-7c27-4568-afa3-d79e0888b8a2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:22.338951 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3dbf0620-2138-42b7-850f-f45c9bd346e2 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:22.339561 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3dbf0620-2138-42b7-850f-f45c9bd346e2 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:22.345746 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3dbf0620-2138-42b7-850f-f45c9bd346e2 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:22.346195 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3dbf0620-2138-42b7-850f-f45c9bd346e2 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:22.346981 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3dbf0620-2138-42b7-850f-f45c9bd346e2 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:22.347416 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3dbf0620-2138-42b7-850f-f45c9bd346e2 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:22.396408 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fd204dac-7c27-4568-afa3-d79e0888b8a2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:22.404605 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fd204dac-7c27-4568-afa3-d79e0888b8a2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.185205 Dec 15 14:08:22.405189 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 334/675] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:22 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:22.409656 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e2c1af21-ef07-47ff-9673-22cb8d0a34d2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:22.410459 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e2c1af21-ef07-47ff-9673-22cb8d0a34d2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:22.416417 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2c1af21-ef07-47ff-9673-22cb8d0a34d2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:22.416895 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2c1af21-ef07-47ff-9673-22cb8d0a34d2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:22.418294 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2c1af21-ef07-47ff-9673-22cb8d0a34d2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:22.418294 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2c1af21-ef07-47ff-9673-22cb8d0a34d2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:22.451491 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2c1af21-ef07-47ff-9673-22cb8d0a34d2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:22.451947 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2c1af21-ef07-47ff-9673-22cb8d0a34d2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:22.452401 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-e2c1af21-ef07-47ff-9673-22cb8d0a34d2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lazy-loading 'fault' on Instance uuid bfccdaf0-2b79-4ace-a816-8c76eba7f48b {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:08:22.514167 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e2c1af21-ef07-47ff-9673-22cb8d0a34d2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:22.522293 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e2c1af21-ef07-47ff-9673-22cb8d0a34d2 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1312 microversion: 2.1 time: 0.116022 Dec 15 14:08:22.523103 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 335/676] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:22 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1312 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:22.523514 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3dbf0620-2138-42b7-850f-f45c9bd346e2 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:22.532714 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3dbf0620-2138-42b7-850f-f45c9bd346e2 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 200 len: 1359 microversion: 2.1 time: 0.197361 Dec 15 14:08:22.533361 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 342/677] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:22 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:23.190830 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e37b0963-231a-41c6-b39f-a9d160b98bdb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:23.191557 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e37b0963-231a-41c6-b39f-a9d160b98bdb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:23.199198 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e37b0963-231a-41c6-b39f-a9d160b98bdb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:23.199714 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e37b0963-231a-41c6-b39f-a9d160b98bdb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:23.200617 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e37b0963-231a-41c6-b39f-a9d160b98bdb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:23.201118 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e37b0963-231a-41c6-b39f-a9d160b98bdb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:23.356901 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e37b0963-231a-41c6-b39f-a9d160b98bdb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:23.365297 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e37b0963-231a-41c6-b39f-a9d160b98bdb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:23.366844 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e37b0963-231a-41c6-b39f-a9d160b98bdb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:23.367990 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e37b0963-231a-41c6-b39f-a9d160b98bdb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1722 microversion: 2.20 time: 0.181549 Dec 15 14:08:23.368553 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 336/678] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:23 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:23.426441 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9bd3e6f6-3ff4-4305-b0d5-05809597937c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:23.427757 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9bd3e6f6-3ff4-4305-b0d5-05809597937c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:23.438290 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bd3e6f6-3ff4-4305-b0d5-05809597937c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:23.439048 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bd3e6f6-3ff4-4305-b0d5-05809597937c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:23.440341 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bd3e6f6-3ff4-4305-b0d5-05809597937c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:23.441178 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bd3e6f6-3ff4-4305-b0d5-05809597937c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:23.538697 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-03652e5f-388c-4cdd-a0d6-667695b71b80 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:23.539301 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-03652e5f-388c-4cdd-a0d6-667695b71b80 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:23.546304 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03652e5f-388c-4cdd-a0d6-667695b71b80 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:23.546304 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03652e5f-388c-4cdd-a0d6-667695b71b80 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:23.547300 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03652e5f-388c-4cdd-a0d6-667695b71b80 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:23.547554 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03652e5f-388c-4cdd-a0d6-667695b71b80 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:23.581697 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03652e5f-388c-4cdd-a0d6-667695b71b80 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:23.582141 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03652e5f-388c-4cdd-a0d6-667695b71b80 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:23.582592 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-03652e5f-388c-4cdd-a0d6-667695b71b80 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lazy-loading 'fault' on Instance uuid bfccdaf0-2b79-4ace-a816-8c76eba7f48b {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:08:23.593700 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9bd3e6f6-3ff4-4305-b0d5-05809597937c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:23.603174 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9bd3e6f6-3ff4-4305-b0d5-05809597937c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.182916 Dec 15 14:08:23.604135 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 343/679] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:23 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:23.608270 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-174bfc71-6472-4342-ad54-e507556ff544 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:23.608961 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-174bfc71-6472-4342-ad54-e507556ff544 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:23.618519 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-174bfc71-6472-4342-ad54-e507556ff544 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:23.618962 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-174bfc71-6472-4342-ad54-e507556ff544 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:23.619756 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-174bfc71-6472-4342-ad54-e507556ff544 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:23.620255 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-174bfc71-6472-4342-ad54-e507556ff544 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:23.631997 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-03652e5f-388c-4cdd-a0d6-667695b71b80 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af34616c9f1f4517b912ea241d1388e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e7e4ff045841da83496eb91b777892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:23.642643 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-03652e5f-388c-4cdd-a0d6-667695b71b80 tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 200 len: 1312 microversion: 2.1 time: 0.107780 Dec 15 14:08:23.643341 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 337/680] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:23 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:23.803360 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-174bfc71-6472-4342-ad54-e507556ff544 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:23.812676 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-174bfc71-6472-4342-ad54-e507556ff544 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 200 len: 1359 microversion: 2.1 time: 0.207383 Dec 15 14:08:23.813490 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 344/681] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:23 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:24.392080 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8c0c4c80-4359-43c4-a308-8121106f6d7d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:24.393000 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8c0c4c80-4359-43c4-a308-8121106f6d7d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:24.403866 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8c0c4c80-4359-43c4-a308-8121106f6d7d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:24.404627 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8c0c4c80-4359-43c4-a308-8121106f6d7d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:24.405945 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8c0c4c80-4359-43c4-a308-8121106f6d7d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:24.406671 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8c0c4c80-4359-43c4-a308-8121106f6d7d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:24.566876 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8c0c4c80-4359-43c4-a308-8121106f6d7d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:24.575031 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8c0c4c80-4359-43c4-a308-8121106f6d7d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:24.576822 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8c0c4c80-4359-43c4-a308-8121106f6d7d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:24.578073 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8c0c4c80-4359-43c4-a308-8121106f6d7d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1722 microversion: 2.20 time: 0.192323 Dec 15 14:08:24.578732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 338/682] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:24 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:24.620010 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2f0b09cc-6afe-4c63-9b97-6e799acefcba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:24.620609 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2f0b09cc-6afe-4c63-9b97-6e799acefcba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:24.626882 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f0b09cc-6afe-4c63-9b97-6e799acefcba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:24.627355 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f0b09cc-6afe-4c63-9b97-6e799acefcba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:24.628119 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f0b09cc-6afe-4c63-9b97-6e799acefcba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:24.628522 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f0b09cc-6afe-4c63-9b97-6e799acefcba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:24.662636 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d3674281-094d-403a-a758-56d0756af28c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:24.663203 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d3674281-094d-403a-a758-56d0756af28c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] [instance: bfccdaf0-2b79-4ace-a816-8c76eba7f48b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:24.670937 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3674281-094d-403a-a758-56d0756af28c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:24.671381 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3674281-094d-403a-a758-56d0756af28c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:24.672167 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3674281-094d-403a-a758-56d0756af28c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:24.672651 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3674281-094d-403a-a758-56d0756af28c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:24.706289 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-d3674281-094d-403a-a758-56d0756af28c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] HTTP exception thrown: Instance bfccdaf0-2b79-4ace-a816-8c76eba7f48b could not be found. Dec 15 14:08:24.707123 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d3674281-094d-403a-a758-56d0756af28c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] Returning 404 to user: Instance bfccdaf0-2b79-4ace-a816-8c76eba7f48b could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:08:24.707972 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d3674281-094d-403a-a758-56d0756af28c tempest-ServerRescueNegativeTestJSON-70842794 tempest-ServerRescueNegativeTestJSON-70842794-project] 10.222.0.42 "GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b" status: 404 len: 111 microversion: 2.1 time: 0.049040 Dec 15 14:08:24.708677 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 339/683] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:24 2021] GET /compute/v2.1/servers/bfccdaf0-2b79-4ace-a816-8c76eba7f48b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 14:08:24.790602 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2f0b09cc-6afe-4c63-9b97-6e799acefcba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:24.798209 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2f0b09cc-6afe-4c63-9b97-6e799acefcba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.181793 Dec 15 14:08:24.799087 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 345/684] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:24 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:24.830875 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f54d25bb-f9e2-460f-a7a9-491f55d461e0 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:24.831629 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f54d25bb-f9e2-460f-a7a9-491f55d461e0 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:24.837951 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f54d25bb-f9e2-460f-a7a9-491f55d461e0 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:24.838476 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f54d25bb-f9e2-460f-a7a9-491f55d461e0 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:24.839394 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f54d25bb-f9e2-460f-a7a9-491f55d461e0 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:24.839928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f54d25bb-f9e2-460f-a7a9-491f55d461e0 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:24.975331 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f54d25bb-f9e2-460f-a7a9-491f55d461e0 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:24.983393 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f54d25bb-f9e2-460f-a7a9-491f55d461e0 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 200 len: 1359 microversion: 2.1 time: 0.156142 Dec 15 14:08:24.984596 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 340/685] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:24 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:25.596414 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-60f2ec84-b533-4364-88da-0f68b6c82c58 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:25.597020 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-60f2ec84-b533-4364-88da-0f68b6c82c58 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:25.604234 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60f2ec84-b533-4364-88da-0f68b6c82c58 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:25.604727 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60f2ec84-b533-4364-88da-0f68b6c82c58 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:25.605516 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60f2ec84-b533-4364-88da-0f68b6c82c58 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:25.605981 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60f2ec84-b533-4364-88da-0f68b6c82c58 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:25.815360 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-37ec0c2e-73f5-421b-bbea-3c8abe0df5fc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:25.816622 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-37ec0c2e-73f5-421b-bbea-3c8abe0df5fc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:25.824483 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-37ec0c2e-73f5-421b-bbea-3c8abe0df5fc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:25.830229 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-37ec0c2e-73f5-421b-bbea-3c8abe0df5fc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:25.831298 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-37ec0c2e-73f5-421b-bbea-3c8abe0df5fc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:25.831920 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-37ec0c2e-73f5-421b-bbea-3c8abe0df5fc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:25.836117 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-60f2ec84-b533-4364-88da-0f68b6c82c58 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:25.846404 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-60f2ec84-b533-4364-88da-0f68b6c82c58 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:25.848131 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-60f2ec84-b533-4364-88da-0f68b6c82c58 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:25.849368 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-60f2ec84-b533-4364-88da-0f68b6c82c58 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1722 microversion: 2.20 time: 0.256848 Dec 15 14:08:25.850239 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 346/686] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:25 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:08:25.878550 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b3ac86d0-978c-493b-b65c-f4400cbc9187 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c735be9-8fcf-4814-a5db-de492281e4b0"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:25.879846 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b3ac86d0-978c-493b-b65c-f4400cbc9187 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:25.887020 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b3ac86d0-978c-493b-b65c-f4400cbc9187 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:25.887571 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b3ac86d0-978c-493b-b65c-f4400cbc9187 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:25.888393 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b3ac86d0-978c-493b-b65c-f4400cbc9187 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:25.889006 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b3ac86d0-978c-493b-b65c-f4400cbc9187 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:26.097505 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-37ec0c2e-73f5-421b-bbea-3c8abe0df5fc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:26.106109 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-37ec0c2e-73f5-421b-bbea-3c8abe0df5fc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.294291 Dec 15 14:08:26.107131 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 341/687] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:25 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:08:26.119017 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-667a09e9-b599-445a-8baf-537baa3bfa00 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:26.119766 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-667a09e9-b599-445a-8baf-537baa3bfa00 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:26.127014 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-667a09e9-b599-445a-8baf-537baa3bfa00 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:26.127467 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-667a09e9-b599-445a-8baf-537baa3bfa00 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:26.128286 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-667a09e9-b599-445a-8baf-537baa3bfa00 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:26.128725 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-667a09e9-b599-445a-8baf-537baa3bfa00 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:26.249083 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b3ac86d0-978c-493b-b65c-f4400cbc9187 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.374309 Dec 15 14:08:26.250162 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 347/688] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Dec 15 14:08:25 2021] POST /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd/os-volume_attachments => generated 194 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:08:26.297139 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-667a09e9-b599-445a-8baf-537baa3bfa00 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:26.313699 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-667a09e9-b599-445a-8baf-537baa3bfa00 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 200 len: 1359 microversion: 2.1 time: 0.199894 Dec 15 14:08:26.320072 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 342/689] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:26 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:26.870112 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8f328def-e014-4751-bd3e-2b0e4a0f2411 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:26.871096 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8f328def-e014-4751-bd3e-2b0e4a0f2411 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:26.877526 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f328def-e014-4751-bd3e-2b0e4a0f2411 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:26.878334 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f328def-e014-4751-bd3e-2b0e4a0f2411 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:26.879362 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f328def-e014-4751-bd3e-2b0e4a0f2411 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:26.880148 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f328def-e014-4751-bd3e-2b0e4a0f2411 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:27.023138 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8f328def-e014-4751-bd3e-2b0e4a0f2411 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:27.031398 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8f328def-e014-4751-bd3e-2b0e4a0f2411 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:27.032897 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8f328def-e014-4751-bd3e-2b0e4a0f2411 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:27.034208 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8f328def-e014-4751-bd3e-2b0e4a0f2411 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1722 microversion: 2.20 time: 0.169368 Dec 15 14:08:27.034969 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 348/690] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:26 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:27.123393 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6f895c2f-2740-49a0-a579-93b4e4e6848c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:27.124376 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6f895c2f-2740-49a0-a579-93b4e4e6848c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:27.131258 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f895c2f-2740-49a0-a579-93b4e4e6848c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:27.131796 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f895c2f-2740-49a0-a579-93b4e4e6848c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:27.132679 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f895c2f-2740-49a0-a579-93b4e4e6848c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:27.133194 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f895c2f-2740-49a0-a579-93b4e4e6848c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:27.279563 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6f895c2f-2740-49a0-a579-93b4e4e6848c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:27.287245 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6f895c2f-2740-49a0-a579-93b4e4e6848c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.167570 Dec 15 14:08:27.287843 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 343/691] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:27 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:27.331068 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f8a6614a-5db9-4f90-a7d1-c8a6949fcd2e tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:27.331764 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f8a6614a-5db9-4f90-a7d1-c8a6949fcd2e tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:27.338579 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8a6614a-5db9-4f90-a7d1-c8a6949fcd2e tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:27.339300 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8a6614a-5db9-4f90-a7d1-c8a6949fcd2e tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:27.340079 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8a6614a-5db9-4f90-a7d1-c8a6949fcd2e tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:27.340524 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8a6614a-5db9-4f90-a7d1-c8a6949fcd2e tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:27.485431 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f8a6614a-5db9-4f90-a7d1-c8a6949fcd2e tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:27.493408 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f8a6614a-5db9-4f90-a7d1-c8a6949fcd2e tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 200 len: 1549 microversion: 2.1 time: 0.166129 Dec 15 14:08:27.494220 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 349/692] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:27 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:27.510842 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7a453342-66ac-4275-9c31-3caaa9beb340 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:27.511579 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7a453342-66ac-4275-9c31-3caaa9beb340 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:27.518183 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a453342-66ac-4275-9c31-3caaa9beb340 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:27.518715 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a453342-66ac-4275-9c31-3caaa9beb340 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:27.519695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a453342-66ac-4275-9c31-3caaa9beb340 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:27.520134 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a453342-66ac-4275-9c31-3caaa9beb340 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:27.669978 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7a453342-66ac-4275-9c31-3caaa9beb340 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:27.677990 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7a453342-66ac-4275-9c31-3caaa9beb340 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 200 len: 1549 microversion: 2.1 time: 0.170854 Dec 15 14:08:27.678584 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 344/693] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:27 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:27.693888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-66cef555-0e1b-4c1b-b319-36fbd537303d tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:27.697671 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:08:27.697671 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:08:27.698678 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-66cef555-0e1b-4c1b-b319-36fbd537303d tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:27.699440 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-66cef555-0e1b-4c1b-b319-36fbd537303d tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Searching by: {'deleted': False, 'project_id': '9192905d4b3645ddb643adaa1439e32d'} {{(pid=116103) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 15 14:08:27.706154 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66cef555-0e1b-4c1b-b319-36fbd537303d tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:27.706727 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66cef555-0e1b-4c1b-b319-36fbd537303d tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:27.707532 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66cef555-0e1b-4c1b-b319-36fbd537303d tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:27.707963 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66cef555-0e1b-4c1b-b319-36fbd537303d tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:27.804037 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.multi_cell_list [None req-66cef555-0e1b-4c1b-b319-36fbd537303d tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 15 14:08:27.903998 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-66cef555-0e1b-4c1b-b319-36fbd537303d tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.213922 Dec 15 14:08:27.905269 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 350/694] 10.222.0.42 () {58 vars in 1124 bytes} [Wed Dec 15 14:08:27 2021] GET /compute/v2.1/servers => generated 343 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:08:27.914901 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ef85ac73-fb3c-47c4-8510-ff55bcd01a0e tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:27.915688 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ef85ac73-fb3c-47c4-8510-ff55bcd01a0e tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:27.921819 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef85ac73-fb3c-47c4-8510-ff55bcd01a0e tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:27.922351 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef85ac73-fb3c-47c4-8510-ff55bcd01a0e tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:27.923195 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef85ac73-fb3c-47c4-8510-ff55bcd01a0e tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:27.923639 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef85ac73-fb3c-47c4-8510-ff55bcd01a0e tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:28.053859 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-593344eb-22b0-43d7-be34-99e0b2d32055 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:28.054875 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-593344eb-22b0-43d7-be34-99e0b2d32055 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:28.067445 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-593344eb-22b0-43d7-be34-99e0b2d32055 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:28.068188 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-593344eb-22b0-43d7-be34-99e0b2d32055 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:28.069559 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-593344eb-22b0-43d7-be34-99e0b2d32055 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:28.070327 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-593344eb-22b0-43d7-be34-99e0b2d32055 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:28.075323 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ef85ac73-fb3c-47c4-8510-ff55bcd01a0e tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:28.083367 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ef85ac73-fb3c-47c4-8510-ff55bcd01a0e tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 200 len: 1549 microversion: 2.1 time: 0.172312 Dec 15 14:08:28.085452 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 345/695] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:27 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:28.286609 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-593344eb-22b0-43d7-be34-99e0b2d32055 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:28.295580 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-593344eb-22b0-43d7-be34-99e0b2d32055 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:28.297521 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-593344eb-22b0-43d7-be34-99e0b2d32055 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:28.298982 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-593344eb-22b0-43d7-be34-99e0b2d32055 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1722 microversion: 2.20 time: 0.249242 Dec 15 14:08:28.299985 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 351/696] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:28 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:08:28.315090 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5cde8efd-8e1c-4bd6-86b8-0c779914ac41 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:28.315902 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5cde8efd-8e1c-4bd6-86b8-0c779914ac41 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:28.323456 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5cde8efd-8e1c-4bd6-86b8-0c779914ac41 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:28.323982 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5cde8efd-8e1c-4bd6-86b8-0c779914ac41 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:28.325159 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5cde8efd-8e1c-4bd6-86b8-0c779914ac41 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:28.325828 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5cde8efd-8e1c-4bd6-86b8-0c779914ac41 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:28.559971 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5cde8efd-8e1c-4bd6-86b8-0c779914ac41 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:28.568124 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5cde8efd-8e1c-4bd6-86b8-0c779914ac41 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.267760 Dec 15 14:08:28.568807 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 346/697] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:28 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:29.521221 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7a0bb85f-8fbe-486b-a967-953c867258e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:29.522130 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7a0bb85f-8fbe-486b-a967-953c867258e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:29.530833 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a0bb85f-8fbe-486b-a967-953c867258e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:29.531612 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a0bb85f-8fbe-486b-a967-953c867258e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:29.532574 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a0bb85f-8fbe-486b-a967-953c867258e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:29.533168 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a0bb85f-8fbe-486b-a967-953c867258e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:29.584593 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c55c618e-2a36-4388-8b82-fe28bf3ead0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:29.585721 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c55c618e-2a36-4388-8b82-fe28bf3ead0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:29.592211 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c55c618e-2a36-4388-8b82-fe28bf3ead0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:29.592946 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c55c618e-2a36-4388-8b82-fe28bf3ead0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:29.594017 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c55c618e-2a36-4388-8b82-fe28bf3ead0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:29.594676 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c55c618e-2a36-4388-8b82-fe28bf3ead0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:29.754662 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7a0bb85f-8fbe-486b-a967-953c867258e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:29.763253 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7a0bb85f-8fbe-486b-a967-953c867258e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:29.765818 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7a0bb85f-8fbe-486b-a967-953c867258e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:29.767008 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7a0bb85f-8fbe-486b-a967-953c867258e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1722 microversion: 2.20 time: 0.453346 Dec 15 14:08:29.767577 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 352/698] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:29 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1722 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:29.810550 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c55c618e-2a36-4388-8b82-fe28bf3ead0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:29.818230 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c55c618e-2a36-4388-8b82-fe28bf3ead0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.237916 Dec 15 14:08:29.821671 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 347/699] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:29 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:30.789502 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-92dd8dbd-5932-4b26-b4f4-0972e9524f66 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:30.790757 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-92dd8dbd-5932-4b26-b4f4-0972e9524f66 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:30.797503 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92dd8dbd-5932-4b26-b4f4-0972e9524f66 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:30.797984 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92dd8dbd-5932-4b26-b4f4-0972e9524f66 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:30.798768 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92dd8dbd-5932-4b26-b4f4-0972e9524f66 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:30.799188 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92dd8dbd-5932-4b26-b4f4-0972e9524f66 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:30.836267 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3dfd5fb4-929a-423b-b4c0-e35341ff68bb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:30.837021 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3dfd5fb4-929a-423b-b4c0-e35341ff68bb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:30.844007 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3dfd5fb4-929a-423b-b4c0-e35341ff68bb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:30.845006 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3dfd5fb4-929a-423b-b4c0-e35341ff68bb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:30.845919 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3dfd5fb4-929a-423b-b4c0-e35341ff68bb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:30.846678 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3dfd5fb4-929a-423b-b4c0-e35341ff68bb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:31.017930 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-92dd8dbd-5932-4b26-b4f4-0972e9524f66 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:31.028101 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-92dd8dbd-5932-4b26-b4f4-0972e9524f66 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:31.029660 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-92dd8dbd-5932-4b26-b4f4-0972e9524f66 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:31.030857 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-92dd8dbd-5932-4b26-b4f4-0972e9524f66 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1722 microversion: 2.20 time: 0.246158 Dec 15 14:08:31.032219 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 353/700] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:30 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:31.073306 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3dfd5fb4-929a-423b-b4c0-e35341ff68bb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:31.080983 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3dfd5fb4-929a-423b-b4c0-e35341ff68bb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.248935 Dec 15 14:08:31.081659 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 348/701] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:30 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:32.049889 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ba1b801d-bacb-4c8f-9366-9314752ce25c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:32.050586 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ba1b801d-bacb-4c8f-9366-9314752ce25c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:32.059359 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba1b801d-bacb-4c8f-9366-9314752ce25c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:32.059800 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba1b801d-bacb-4c8f-9366-9314752ce25c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:32.061703 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba1b801d-bacb-4c8f-9366-9314752ce25c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:32.062191 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba1b801d-bacb-4c8f-9366-9314752ce25c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:32.103328 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bd1e10eb-4174-4264-9e1d-86dbfbe4e74c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:32.103972 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bd1e10eb-4174-4264-9e1d-86dbfbe4e74c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:32.110817 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd1e10eb-4174-4264-9e1d-86dbfbe4e74c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:32.111581 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd1e10eb-4174-4264-9e1d-86dbfbe4e74c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:32.112348 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd1e10eb-4174-4264-9e1d-86dbfbe4e74c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:32.112776 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd1e10eb-4174-4264-9e1d-86dbfbe4e74c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:32.251427 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ba1b801d-bacb-4c8f-9366-9314752ce25c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:32.262352 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ba1b801d-bacb-4c8f-9366-9314752ce25c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:32.264051 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ba1b801d-bacb-4c8f-9366-9314752ce25c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:32.265355 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ba1b801d-bacb-4c8f-9366-9314752ce25c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1722 microversion: 2.20 time: 0.219096 Dec 15 14:08:32.273784 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 354/702] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:32 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:32.293640 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bd1e10eb-4174-4264-9e1d-86dbfbe4e74c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:32.301347 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bd1e10eb-4174-4264-9e1d-86dbfbe4e74c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.207075 Dec 15 14:08:32.302095 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 349/703] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:32 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:33.284191 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-574981a1-87e5-4b68-a1c5-6eb74178d1f0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:33.284750 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-574981a1-87e5-4b68-a1c5-6eb74178d1f0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:33.291276 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-574981a1-87e5-4b68-a1c5-6eb74178d1f0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:33.291734 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-574981a1-87e5-4b68-a1c5-6eb74178d1f0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:33.292659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-574981a1-87e5-4b68-a1c5-6eb74178d1f0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:33.293469 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-574981a1-87e5-4b68-a1c5-6eb74178d1f0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:33.318267 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9a575838-b818-4c76-920d-8374a7a1d42d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:33.319106 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9a575838-b818-4c76-920d-8374a7a1d42d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:33.326192 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a575838-b818-4c76-920d-8374a7a1d42d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:33.326938 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a575838-b818-4c76-920d-8374a7a1d42d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:33.327930 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a575838-b818-4c76-920d-8374a7a1d42d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:33.328522 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a575838-b818-4c76-920d-8374a7a1d42d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:33.713093 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-574981a1-87e5-4b68-a1c5-6eb74178d1f0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:33.721690 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-574981a1-87e5-4b68-a1c5-6eb74178d1f0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:33.723227 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-574981a1-87e5-4b68-a1c5-6eb74178d1f0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:33.724932 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-574981a1-87e5-4b68-a1c5-6eb74178d1f0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1722 microversion: 2.20 time: 0.444265 Dec 15 14:08:33.725681 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 355/704] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:33 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1722 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:33.744311 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9a575838-b818-4c76-920d-8374a7a1d42d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:33.752397 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9a575838-b818-4c76-920d-8374a7a1d42d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.437823 Dec 15 14:08:33.752960 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 350/705] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:33 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:34.743783 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4554c156-3dc3-49d5-93e4-c94ab79e472c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:34.744521 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4554c156-3dc3-49d5-93e4-c94ab79e472c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:34.750979 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4554c156-3dc3-49d5-93e4-c94ab79e472c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:34.751425 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4554c156-3dc3-49d5-93e4-c94ab79e472c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:34.752200 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4554c156-3dc3-49d5-93e4-c94ab79e472c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:34.752780 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4554c156-3dc3-49d5-93e4-c94ab79e472c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:34.772631 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5eb477cb-ae61-4014-af77-a91e5e2e86b7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:34.773939 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5eb477cb-ae61-4014-af77-a91e5e2e86b7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:34.781364 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5eb477cb-ae61-4014-af77-a91e5e2e86b7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:34.783694 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5eb477cb-ae61-4014-af77-a91e5e2e86b7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:34.784666 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5eb477cb-ae61-4014-af77-a91e5e2e86b7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:34.785452 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5eb477cb-ae61-4014-af77-a91e5e2e86b7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:34.978062 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4554c156-3dc3-49d5-93e4-c94ab79e472c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:34.982636 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5eb477cb-ae61-4014-af77-a91e5e2e86b7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:34.992894 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4554c156-3dc3-49d5-93e4-c94ab79e472c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:34.993572 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5eb477cb-ae61-4014-af77-a91e5e2e86b7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.225345 Dec 15 14:08:34.994196 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 351/706] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:34 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:34.994502 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4554c156-3dc3-49d5-93e4-c94ab79e472c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:34.996138 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4554c156-3dc3-49d5-93e4-c94ab79e472c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1722 microversion: 2.20 time: 0.256060 Dec 15 14:08:34.996810 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 356/707] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:34 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:36.011898 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-62c19861-9bb2-4625-9750-b5e0d3b83aae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:36.012783 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-62c19861-9bb2-4625-9750-b5e0d3b83aae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:36.015746 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dec6139d-f287-498b-8dfc-165cd50578cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:36.016647 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dec6139d-f287-498b-8dfc-165cd50578cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:36.019955 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62c19861-9bb2-4625-9750-b5e0d3b83aae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:36.020540 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62c19861-9bb2-4625-9750-b5e0d3b83aae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:36.021419 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62c19861-9bb2-4625-9750-b5e0d3b83aae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:36.022431 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dec6139d-f287-498b-8dfc-165cd50578cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:36.022649 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62c19861-9bb2-4625-9750-b5e0d3b83aae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:36.022876 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dec6139d-f287-498b-8dfc-165cd50578cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:36.023660 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dec6139d-f287-498b-8dfc-165cd50578cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:36.024094 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dec6139d-f287-498b-8dfc-165cd50578cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:36.219762 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dec6139d-f287-498b-8dfc-165cd50578cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:36.229510 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dec6139d-f287-498b-8dfc-165cd50578cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:36.231686 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dec6139d-f287-498b-8dfc-165cd50578cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:36.232855 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dec6139d-f287-498b-8dfc-165cd50578cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1722 microversion: 2.20 time: 0.220706 Dec 15 14:08:36.233581 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 357/708] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:36 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:36.238543 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-62c19861-9bb2-4625-9750-b5e0d3b83aae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:36.246527 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-62c19861-9bb2-4625-9750-b5e0d3b83aae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.238663 Dec 15 14:08:36.247176 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 352/709] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:36 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:37.251888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d9aed04d-f15c-4c37-b252-85b0dee63a9d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:37.252556 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d9aed04d-f15c-4c37-b252-85b0dee63a9d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:37.259622 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9aed04d-f15c-4c37-b252-85b0dee63a9d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:37.260073 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9aed04d-f15c-4c37-b252-85b0dee63a9d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:37.260915 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9aed04d-f15c-4c37-b252-85b0dee63a9d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:37.261297 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9aed04d-f15c-4c37-b252-85b0dee63a9d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:37.264730 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1c6c6da2-59bd-45ec-933d-a9285b269451 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:37.265442 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1c6c6da2-59bd-45ec-933d-a9285b269451 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:37.272244 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c6c6da2-59bd-45ec-933d-a9285b269451 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:37.273186 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c6c6da2-59bd-45ec-933d-a9285b269451 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:37.274224 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c6c6da2-59bd-45ec-933d-a9285b269451 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:37.274772 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c6c6da2-59bd-45ec-933d-a9285b269451 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:37.456484 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d9aed04d-f15c-4c37-b252-85b0dee63a9d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:37.465155 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d9aed04d-f15c-4c37-b252-85b0dee63a9d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:37.466665 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d9aed04d-f15c-4c37-b252-85b0dee63a9d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:37.467851 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d9aed04d-f15c-4c37-b252-85b0dee63a9d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1743 microversion: 2.20 time: 0.219910 Dec 15 14:08:37.468435 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 358/710] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:37 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1743 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:37.490952 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1c6c6da2-59bd-45ec-933d-a9285b269451 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:37.499068 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1c6c6da2-59bd-45ec-933d-a9285b269451 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.238314 Dec 15 14:08:37.499651 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 353/711] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:37 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:08:38.488093 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f4ca4634-6b60-4e40-ba4e-e5ca2fd0c0c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:38.489327 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f4ca4634-6b60-4e40-ba4e-e5ca2fd0c0c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:38.498090 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4ca4634-6b60-4e40-ba4e-e5ca2fd0c0c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:38.498621 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4ca4634-6b60-4e40-ba4e-e5ca2fd0c0c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:38.499467 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4ca4634-6b60-4e40-ba4e-e5ca2fd0c0c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:38.499964 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4ca4634-6b60-4e40-ba4e-e5ca2fd0c0c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:38.520219 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ff808bf9-dd41-402f-aad2-1b049f397284 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:38.522354 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ff808bf9-dd41-402f-aad2-1b049f397284 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:38.533345 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ff808bf9-dd41-402f-aad2-1b049f397284 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:38.534304 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ff808bf9-dd41-402f-aad2-1b049f397284 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:38.535917 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ff808bf9-dd41-402f-aad2-1b049f397284 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:38.538410 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ff808bf9-dd41-402f-aad2-1b049f397284 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:38.712534 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f4ca4634-6b60-4e40-ba4e-e5ca2fd0c0c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:38.722595 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f4ca4634-6b60-4e40-ba4e-e5ca2fd0c0c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:38.724349 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f4ca4634-6b60-4e40-ba4e-e5ca2fd0c0c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:38.726652 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f4ca4634-6b60-4e40-ba4e-e5ca2fd0c0c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1743 microversion: 2.20 time: 0.242166 Dec 15 14:08:38.727670 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 359/712] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:38 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1743 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:38.777985 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ff808bf9-dd41-402f-aad2-1b049f397284 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:38.789552 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ff808bf9-dd41-402f-aad2-1b049f397284 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.276506 Dec 15 14:08:38.791114 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 354/713] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:38 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:39.750371 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9d4990f2-f617-4f4e-8acd-28c3b28dfa51 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:39.751296 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9d4990f2-f617-4f4e-8acd-28c3b28dfa51 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:39.760414 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d4990f2-f617-4f4e-8acd-28c3b28dfa51 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:39.760913 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d4990f2-f617-4f4e-8acd-28c3b28dfa51 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:39.761750 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d4990f2-f617-4f4e-8acd-28c3b28dfa51 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:39.762193 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d4990f2-f617-4f4e-8acd-28c3b28dfa51 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:39.806056 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3336528a-1b37-4301-84e6-e72bf768a151 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:39.806648 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3336528a-1b37-4301-84e6-e72bf768a151 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:39.813474 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3336528a-1b37-4301-84e6-e72bf768a151 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:39.813955 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3336528a-1b37-4301-84e6-e72bf768a151 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:39.814751 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3336528a-1b37-4301-84e6-e72bf768a151 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:39.815190 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3336528a-1b37-4301-84e6-e72bf768a151 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:39.942161 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9d4990f2-f617-4f4e-8acd-28c3b28dfa51 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:39.951262 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9d4990f2-f617-4f4e-8acd-28c3b28dfa51 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:39.952904 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9d4990f2-f617-4f4e-8acd-28c3b28dfa51 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:39.954105 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9d4990f2-f617-4f4e-8acd-28c3b28dfa51 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1743 microversion: 2.20 time: 0.210349 Dec 15 14:08:39.954639 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 360/714] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:39 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1743 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:39.995269 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3336528a-1b37-4301-84e6-e72bf768a151 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:40.002984 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3336528a-1b37-4301-84e6-e72bf768a151 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.200688 Dec 15 14:08:40.003697 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 355/715] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:39 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:40.633418 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-38cb13e6-4345-4b99-a5a3-fecdb9cc74db req-d0afe995-b1b2-41d3-b134-4bd880b7d3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc65306-f419-4eac-97a2-407c5d6744da", "name": "network-vif-plugged", "status": "completed", "tag": "7989001b-405b-4c40-b4ff-1aeb457e4e50"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:40.635000 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:08:40.635000 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:08:40.642620 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-38cb13e6-4345-4b99-a5a3-fecdb9cc74db req-d0afe995-b1b2-41d3-b134-4bd880b7d3a9 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:40.643319 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-38cb13e6-4345-4b99-a5a3-fecdb9cc74db req-d0afe995-b1b2-41d3-b134-4bd880b7d3a9 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:40.655967 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-38cb13e6-4345-4b99-a5a3-fecdb9cc74db req-d0afe995-b1b2-41d3-b134-4bd880b7d3a9 service nova] Creating event network-vif-plugged:7989001b-405b-4c40-b4ff-1aeb457e4e50 for instance fcc65306-f419-4eac-97a2-407c5d6744da on hv-cinder-82182 Dec 15 14:08:40.661524 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-38cb13e6-4345-4b99-a5a3-fecdb9cc74db req-d0afe995-b1b2-41d3-b134-4bd880b7d3a9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031935 Dec 15 14:08:40.662222 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 361/716] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:08:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:08:40.977518 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-90736e9d-01c3-4599-af74-6ae7b6e6f898 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:40.978528 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-90736e9d-01c3-4599-af74-6ae7b6e6f898 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:40.989191 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90736e9d-01c3-4599-af74-6ae7b6e6f898 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:40.989993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90736e9d-01c3-4599-af74-6ae7b6e6f898 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:40.991441 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90736e9d-01c3-4599-af74-6ae7b6e6f898 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:40.992000 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90736e9d-01c3-4599-af74-6ae7b6e6f898 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:41.021078 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a8669ebd-890e-47d9-b699-3a23a244a48c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:41.021921 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a8669ebd-890e-47d9-b699-3a23a244a48c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:41.029309 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8669ebd-890e-47d9-b699-3a23a244a48c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:41.029767 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8669ebd-890e-47d9-b699-3a23a244a48c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:41.030574 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8669ebd-890e-47d9-b699-3a23a244a48c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:41.031065 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8669ebd-890e-47d9-b699-3a23a244a48c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:41.181132 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-90736e9d-01c3-4599-af74-6ae7b6e6f898 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:41.190124 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-90736e9d-01c3-4599-af74-6ae7b6e6f898 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:41.191914 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-90736e9d-01c3-4599-af74-6ae7b6e6f898 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:41.193356 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-90736e9d-01c3-4599-af74-6ae7b6e6f898 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1743 microversion: 2.20 time: 0.222760 Dec 15 14:08:41.194031 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 356/717] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:40 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1743 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:41.215077 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a8669ebd-890e-47d9-b699-3a23a244a48c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:41.222852 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a8669ebd-890e-47d9-b699-3a23a244a48c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.206488 Dec 15 14:08:41.223412 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 362/718] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:41 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:42.212194 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2c92e832-62b1-4254-be8b-c4b99bbddf84 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:42.212754 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2c92e832-62b1-4254-be8b-c4b99bbddf84 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:42.219920 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c92e832-62b1-4254-be8b-c4b99bbddf84 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:42.220353 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c92e832-62b1-4254-be8b-c4b99bbddf84 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:42.221372 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c92e832-62b1-4254-be8b-c4b99bbddf84 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:42.221995 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c92e832-62b1-4254-be8b-c4b99bbddf84 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:42.242045 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3ecf0ece-b0f5-4bf6-b128-f1dce9d3a257 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:42.243389 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3ecf0ece-b0f5-4bf6-b128-f1dce9d3a257 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:42.251027 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ecf0ece-b0f5-4bf6-b128-f1dce9d3a257 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:42.251989 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ecf0ece-b0f5-4bf6-b128-f1dce9d3a257 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:42.252991 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ecf0ece-b0f5-4bf6-b128-f1dce9d3a257 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:42.253639 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ecf0ece-b0f5-4bf6-b128-f1dce9d3a257 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:42.489893 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2c92e832-62b1-4254-be8b-c4b99bbddf84 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:42.499287 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2c92e832-62b1-4254-be8b-c4b99bbddf84 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:42.501027 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2c92e832-62b1-4254-be8b-c4b99bbddf84 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:42.502524 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2c92e832-62b1-4254-be8b-c4b99bbddf84 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1738 microversion: 2.20 time: 0.294496 Dec 15 14:08:42.506191 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3ecf0ece-b0f5-4bf6-b128-f1dce9d3a257 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:42.529844 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3ecf0ece-b0f5-4bf6-b128-f1dce9d3a257 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.280818 Dec 15 14:08:42.529844 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 363/719] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:42 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:42.531358 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 357/720] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:42 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1738 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:43.528426 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-830008bd-307d-4474-bc86-a75f032298ef tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:43.529155 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-830008bd-307d-4474-bc86-a75f032298ef tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:43.538569 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-830008bd-307d-4474-bc86-a75f032298ef tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:43.541103 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7c6ae726-f86a-4a06-a8ce-b9b2939ebd0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:43.542090 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7c6ae726-f86a-4a06-a8ce-b9b2939ebd0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:43.542679 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-830008bd-307d-4474-bc86-a75f032298ef tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:43.544784 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-830008bd-307d-4474-bc86-a75f032298ef tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:43.546290 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-830008bd-307d-4474-bc86-a75f032298ef tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:43.553650 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7c6ae726-f86a-4a06-a8ce-b9b2939ebd0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:43.554717 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7c6ae726-f86a-4a06-a8ce-b9b2939ebd0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:43.555325 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7c6ae726-f86a-4a06-a8ce-b9b2939ebd0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:43.555768 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7c6ae726-f86a-4a06-a8ce-b9b2939ebd0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:43.812478 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7c6ae726-f86a-4a06-a8ce-b9b2939ebd0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:43.815791 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-830008bd-307d-4474-bc86-a75f032298ef tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:43.822583 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7c6ae726-f86a-4a06-a8ce-b9b2939ebd0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.287042 Dec 15 14:08:43.823446 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 358/721] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:43 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:43.827411 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-830008bd-307d-4474-bc86-a75f032298ef tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:43.828932 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-830008bd-307d-4474-bc86-a75f032298ef tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:43.830928 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-830008bd-307d-4474-bc86-a75f032298ef tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1738 microversion: 2.20 time: 0.306217 Dec 15 14:08:43.838189 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 364/722] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:43 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1738 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:44.840391 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-39949fa0-561c-4b43-aaf4-dcf73075b8c2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:44.841749 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-39949fa0-561c-4b43-aaf4-dcf73075b8c2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:44.848890 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39949fa0-561c-4b43-aaf4-dcf73075b8c2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:44.849416 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-31dbf073-41fb-4bcb-99d1-6b1669dae860 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:44.850021 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39949fa0-561c-4b43-aaf4-dcf73075b8c2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:44.850427 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39949fa0-561c-4b43-aaf4-dcf73075b8c2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:44.851204 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-31dbf073-41fb-4bcb-99d1-6b1669dae860 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:44.851822 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39949fa0-561c-4b43-aaf4-dcf73075b8c2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:44.872554 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31dbf073-41fb-4bcb-99d1-6b1669dae860 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:44.873463 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31dbf073-41fb-4bcb-99d1-6b1669dae860 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:44.874571 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31dbf073-41fb-4bcb-99d1-6b1669dae860 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:44.875267 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31dbf073-41fb-4bcb-99d1-6b1669dae860 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:45.081166 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-39949fa0-561c-4b43-aaf4-dcf73075b8c2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:45.090527 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-39949fa0-561c-4b43-aaf4-dcf73075b8c2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.253964 Dec 15 14:08:45.091213 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 359/723] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:44 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:08:45.115458 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-31dbf073-41fb-4bcb-99d1-6b1669dae860 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:45.127370 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-31dbf073-41fb-4bcb-99d1-6b1669dae860 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:45.129205 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-31dbf073-41fb-4bcb-99d1-6b1669dae860 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:45.130843 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-31dbf073-41fb-4bcb-99d1-6b1669dae860 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1738 microversion: 2.20 time: 0.285064 Dec 15 14:08:45.131603 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 365/724] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:44 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1738 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:08:46.107322 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-eb195b5c-fbcd-47ad-bff3-438e3f6edce3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:46.108017 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-eb195b5c-fbcd-47ad-bff3-438e3f6edce3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:46.118850 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eb195b5c-fbcd-47ad-bff3-438e3f6edce3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:46.119390 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eb195b5c-fbcd-47ad-bff3-438e3f6edce3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:46.120245 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eb195b5c-fbcd-47ad-bff3-438e3f6edce3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:46.120684 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eb195b5c-fbcd-47ad-bff3-438e3f6edce3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:46.149805 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2cbf3f86-ad24-4027-b076-aa10dcbed61f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:46.151107 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2cbf3f86-ad24-4027-b076-aa10dcbed61f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:46.177972 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2cbf3f86-ad24-4027-b076-aa10dcbed61f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:46.178800 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2cbf3f86-ad24-4027-b076-aa10dcbed61f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:46.180254 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2cbf3f86-ad24-4027-b076-aa10dcbed61f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:46.180697 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2cbf3f86-ad24-4027-b076-aa10dcbed61f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:46.317065 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-eb195b5c-fbcd-47ad-bff3-438e3f6edce3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:46.332308 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-eb195b5c-fbcd-47ad-bff3-438e3f6edce3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.226782 Dec 15 14:08:46.333089 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 360/725] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:46 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:46.378069 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2cbf3f86-ad24-4027-b076-aa10dcbed61f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:46.387191 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2cbf3f86-ad24-4027-b076-aa10dcbed61f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:46.388822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2cbf3f86-ad24-4027-b076-aa10dcbed61f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:46.390310 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2cbf3f86-ad24-4027-b076-aa10dcbed61f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1738 microversion: 2.20 time: 0.244735 Dec 15 14:08:46.390970 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 366/726] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:46 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1738 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:47.349958 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c3c4f002-4ab3-47f8-9c3b-8168ec946ea2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:47.351208 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c3c4f002-4ab3-47f8-9c3b-8168ec946ea2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:47.357520 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3c4f002-4ab3-47f8-9c3b-8168ec946ea2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:47.358180 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3c4f002-4ab3-47f8-9c3b-8168ec946ea2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:47.359254 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3c4f002-4ab3-47f8-9c3b-8168ec946ea2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:47.359677 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3c4f002-4ab3-47f8-9c3b-8168ec946ea2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:47.408218 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2fdb5ce2-cd5c-497e-96db-9804352ceda1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:47.408856 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2fdb5ce2-cd5c-497e-96db-9804352ceda1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:47.416474 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2fdb5ce2-cd5c-497e-96db-9804352ceda1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:47.417299 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2fdb5ce2-cd5c-497e-96db-9804352ceda1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:47.418353 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2fdb5ce2-cd5c-497e-96db-9804352ceda1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:47.418977 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2fdb5ce2-cd5c-497e-96db-9804352ceda1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:47.633965 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c3c4f002-4ab3-47f8-9c3b-8168ec946ea2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:47.636252 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2fdb5ce2-cd5c-497e-96db-9804352ceda1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:47.641043 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c3c4f002-4ab3-47f8-9c3b-8168ec946ea2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.294946 Dec 15 14:08:47.642002 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 361/727] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:47 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:47.644562 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2fdb5ce2-cd5c-497e-96db-9804352ceda1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:47.646831 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2fdb5ce2-cd5c-497e-96db-9804352ceda1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:47.648165 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2fdb5ce2-cd5c-497e-96db-9804352ceda1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1738 microversion: 2.20 time: 0.243722 Dec 15 14:08:47.657694 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 367/728] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:47 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1738 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:48.658614 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2b0b8b4a-0082-435d-b956-0ebc3588daf5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:48.659395 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2b0b8b4a-0082-435d-b956-0ebc3588daf5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:48.666790 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b0b8b4a-0082-435d-b956-0ebc3588daf5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:48.667471 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b0b8b4a-0082-435d-b956-0ebc3588daf5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:48.668423 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b0b8b4a-0082-435d-b956-0ebc3588daf5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:48.668859 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b0b8b4a-0082-435d-b956-0ebc3588daf5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:48.672028 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cd6e6b12-1b39-48d6-92e9-6080abecd206 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:48.673756 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cd6e6b12-1b39-48d6-92e9-6080abecd206 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:48.685532 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd6e6b12-1b39-48d6-92e9-6080abecd206 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:48.686412 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd6e6b12-1b39-48d6-92e9-6080abecd206 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:48.687455 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd6e6b12-1b39-48d6-92e9-6080abecd206 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:48.690103 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd6e6b12-1b39-48d6-92e9-6080abecd206 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:48.946496 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2b0b8b4a-0082-435d-b956-0ebc3588daf5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:48.958941 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cd6e6b12-1b39-48d6-92e9-6080abecd206 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:48.959509 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2b0b8b4a-0082-435d-b956-0ebc3588daf5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.304868 Dec 15 14:08:48.960491 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 362/729] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:48 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:48.970358 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cd6e6b12-1b39-48d6-92e9-6080abecd206 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:48.975915 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cd6e6b12-1b39-48d6-92e9-6080abecd206 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:48.978659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cd6e6b12-1b39-48d6-92e9-6080abecd206 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1738 microversion: 2.20 time: 0.310912 Dec 15 14:08:48.991198 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 368/730] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:48 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1738 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:08:49.978155 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b494d118-7964-40c3-a279-cef8ddd7b0cb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:49.978862 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b494d118-7964-40c3-a279-cef8ddd7b0cb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:49.985431 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b494d118-7964-40c3-a279-cef8ddd7b0cb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:49.985912 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b494d118-7964-40c3-a279-cef8ddd7b0cb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:49.986725 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b494d118-7964-40c3-a279-cef8ddd7b0cb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:49.987168 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b494d118-7964-40c3-a279-cef8ddd7b0cb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:50.000339 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ad835781-7bb5-43e0-ab36-d1a344b6ce93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:50.003000 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ad835781-7bb5-43e0-ab36-d1a344b6ce93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:50.019254 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad835781-7bb5-43e0-ab36-d1a344b6ce93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:50.019897 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad835781-7bb5-43e0-ab36-d1a344b6ce93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:50.022468 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad835781-7bb5-43e0-ab36-d1a344b6ce93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:50.026844 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad835781-7bb5-43e0-ab36-d1a344b6ce93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:50.242466 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b494d118-7964-40c3-a279-cef8ddd7b0cb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:50.252695 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ad835781-7bb5-43e0-ab36-d1a344b6ce93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:50.255291 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b494d118-7964-40c3-a279-cef8ddd7b0cb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.281306 Dec 15 14:08:50.257292 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 363/731] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:49 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:50.263270 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ad835781-7bb5-43e0-ab36-d1a344b6ce93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:50.264986 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ad835781-7bb5-43e0-ab36-d1a344b6ce93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:50.266382 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ad835781-7bb5-43e0-ab36-d1a344b6ce93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1738 microversion: 2.20 time: 0.270246 Dec 15 14:08:50.278293 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 369/732] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:49 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1738 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:51.273782 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e65ca113-51fa-4db3-a50f-fe549e6db12d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:51.274430 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e65ca113-51fa-4db3-a50f-fe549e6db12d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:51.283315 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e65ca113-51fa-4db3-a50f-fe549e6db12d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:51.287056 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dbe3935e-308f-4ffe-8759-1f8792a2ed8d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:51.288457 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dbe3935e-308f-4ffe-8759-1f8792a2ed8d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:51.293785 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e65ca113-51fa-4db3-a50f-fe549e6db12d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:51.294965 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e65ca113-51fa-4db3-a50f-fe549e6db12d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:51.295400 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e65ca113-51fa-4db3-a50f-fe549e6db12d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:51.296809 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dbe3935e-308f-4ffe-8759-1f8792a2ed8d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:51.297960 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dbe3935e-308f-4ffe-8759-1f8792a2ed8d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:51.301283 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dbe3935e-308f-4ffe-8759-1f8792a2ed8d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:51.301928 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dbe3935e-308f-4ffe-8759-1f8792a2ed8d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:51.540472 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dbe3935e-308f-4ffe-8759-1f8792a2ed8d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:51.544635 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e65ca113-51fa-4db3-a50f-fe549e6db12d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:51.549692 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dbe3935e-308f-4ffe-8759-1f8792a2ed8d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:51.551650 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dbe3935e-308f-4ffe-8759-1f8792a2ed8d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:51.552962 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dbe3935e-308f-4ffe-8759-1f8792a2ed8d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1738 microversion: 2.20 time: 0.271139 Dec 15 14:08:51.553766 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 370/733] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:51 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1738 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:51.555989 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e65ca113-51fa-4db3-a50f-fe549e6db12d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.285954 Dec 15 14:08:51.564654 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 364/734] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:51 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:52.572166 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f6cdaf2e-964f-42c6-9fe6-a6ab94e2ae3e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:52.572723 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f6cdaf2e-964f-42c6-9fe6-a6ab94e2ae3e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:52.573331 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-882a691e-b691-4fb1-b47b-b8daefecd8c7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:52.574056 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-882a691e-b691-4fb1-b47b-b8daefecd8c7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:52.579267 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6cdaf2e-964f-42c6-9fe6-a6ab94e2ae3e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:52.579696 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6cdaf2e-964f-42c6-9fe6-a6ab94e2ae3e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:52.580489 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6cdaf2e-964f-42c6-9fe6-a6ab94e2ae3e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:52.580744 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-882a691e-b691-4fb1-b47b-b8daefecd8c7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:52.580908 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6cdaf2e-964f-42c6-9fe6-a6ab94e2ae3e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:52.581265 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-882a691e-b691-4fb1-b47b-b8daefecd8c7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:52.582105 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-882a691e-b691-4fb1-b47b-b8daefecd8c7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:52.582756 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-882a691e-b691-4fb1-b47b-b8daefecd8c7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:52.866723 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f6cdaf2e-964f-42c6-9fe6-a6ab94e2ae3e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:52.876299 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f6cdaf2e-964f-42c6-9fe6-a6ab94e2ae3e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:52.877967 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f6cdaf2e-964f-42c6-9fe6-a6ab94e2ae3e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:52.879397 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f6cdaf2e-964f-42c6-9fe6-a6ab94e2ae3e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1720 microversion: 2.20 time: 0.311066 Dec 15 14:08:52.880037 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 371/735] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:52 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1720 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:52.887594 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-882a691e-b691-4fb1-b47b-b8daefecd8c7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:52.895728 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-882a691e-b691-4fb1-b47b-b8daefecd8c7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.326109 Dec 15 14:08:52.896374 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 365/736] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:52 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:08:53.902882 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7f0b7832-52f4-401d-bb59-ad7236e7a9e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:53.903847 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7f0b7832-52f4-401d-bb59-ad7236e7a9e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:53.915067 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f0b7832-52f4-401d-bb59-ad7236e7a9e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:53.915810 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f0b7832-52f4-401d-bb59-ad7236e7a9e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:53.916733 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bc15bf39-1f31-4b35-92bc-c202a7f96d89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:53.917480 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f0b7832-52f4-401d-bb59-ad7236e7a9e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:53.917833 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bc15bf39-1f31-4b35-92bc-c202a7f96d89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:53.918043 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f0b7832-52f4-401d-bb59-ad7236e7a9e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:53.928309 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bc15bf39-1f31-4b35-92bc-c202a7f96d89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:53.929768 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bc15bf39-1f31-4b35-92bc-c202a7f96d89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:53.930567 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bc15bf39-1f31-4b35-92bc-c202a7f96d89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:53.931033 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bc15bf39-1f31-4b35-92bc-c202a7f96d89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:54.138337 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7f0b7832-52f4-401d-bb59-ad7236e7a9e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:54.142235 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bc15bf39-1f31-4b35-92bc-c202a7f96d89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:54.146787 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7f0b7832-52f4-401d-bb59-ad7236e7a9e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:54.148818 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7f0b7832-52f4-401d-bb59-ad7236e7a9e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:54.150101 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7f0b7832-52f4-401d-bb59-ad7236e7a9e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1720 microversion: 2.20 time: 0.254038 Dec 15 14:08:54.150270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bc15bf39-1f31-4b35-92bc-c202a7f96d89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.240441 Dec 15 14:08:54.151019 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 372/737] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:53 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1720 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:54.151155 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 366/738] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:53 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:55.172029 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bdba4d1c-8319-4670-bd5c-db6accc0d56d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:55.172947 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bdba4d1c-8319-4670-bd5c-db6accc0d56d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:55.174994 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8b8b8e8a-3aa3-46ea-ac8a-c733f0a5f41a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:55.176087 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8b8b8e8a-3aa3-46ea-ac8a-c733f0a5f41a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:55.182783 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bdba4d1c-8319-4670-bd5c-db6accc0d56d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:55.183228 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bdba4d1c-8319-4670-bd5c-db6accc0d56d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:55.183816 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b8b8e8a-3aa3-46ea-ac8a-c733f0a5f41a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:55.183993 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bdba4d1c-8319-4670-bd5c-db6accc0d56d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:55.184270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b8b8e8a-3aa3-46ea-ac8a-c733f0a5f41a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:55.184432 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bdba4d1c-8319-4670-bd5c-db6accc0d56d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:55.185043 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b8b8e8a-3aa3-46ea-ac8a-c733f0a5f41a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:55.185503 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b8b8e8a-3aa3-46ea-ac8a-c733f0a5f41a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:55.397208 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8b8b8e8a-3aa3-46ea-ac8a-c733f0a5f41a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:55.402254 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bdba4d1c-8319-4670-bd5c-db6accc0d56d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:55.413142 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bdba4d1c-8319-4670-bd5c-db6accc0d56d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:55.415227 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bdba4d1c-8319-4670-bd5c-db6accc0d56d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:55.416096 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8b8b8e8a-3aa3-46ea-ac8a-c733f0a5f41a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.246696 Dec 15 14:08:55.416221 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bdba4d1c-8319-4670-bd5c-db6accc0d56d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1723 microversion: 2.20 time: 0.250109 Dec 15 14:08:55.416751 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 373/739] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:55 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:55.424177 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 367/740] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:55 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:55.434893 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-36fba710-e9c8-4913-b1bc-79eca1a4e1e7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7267792b-a221-4709-9588-a9838e8b0eec"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:55.435990 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-36fba710-e9c8-4913-b1bc-79eca1a4e1e7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:55.441886 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36fba710-e9c8-4913-b1bc-79eca1a4e1e7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:55.442328 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36fba710-e9c8-4913-b1bc-79eca1a4e1e7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:55.443111 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36fba710-e9c8-4913-b1bc-79eca1a4e1e7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:55.443545 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36fba710-e9c8-4913-b1bc-79eca1a4e1e7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:55.809066 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-36fba710-e9c8-4913-b1bc-79eca1a4e1e7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.378546 Dec 15 14:08:55.810123 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 374/741] 10.222.0.42 () {62 vars in 1363 bytes} [Wed Dec 15 14:08:55 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/os-volume_attachments => generated 188 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:08:55.940661 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dcaf7a97-88f7-419c-a3a7-3c2d223528aa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:55.941224 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dcaf7a97-88f7-419c-a3a7-3c2d223528aa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:55.948665 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dcaf7a97-88f7-419c-a3a7-3c2d223528aa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:55.950205 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dcaf7a97-88f7-419c-a3a7-3c2d223528aa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:55.951017 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dcaf7a97-88f7-419c-a3a7-3c2d223528aa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:55.951453 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dcaf7a97-88f7-419c-a3a7-3c2d223528aa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:56.120917 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dcaf7a97-88f7-419c-a3a7-3c2d223528aa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action" status: 202 len: 0 microversion: 2.20 time: 0.183988 Dec 15 14:08:56.122227 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 368/742] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:08:55 2021] POST /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:08:56.130465 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-00560805-9819-4a9f-8689-84e7e2808e72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:56.131182 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-00560805-9819-4a9f-8689-84e7e2808e72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:56.139966 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00560805-9819-4a9f-8689-84e7e2808e72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:56.140428 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00560805-9819-4a9f-8689-84e7e2808e72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:56.141226 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00560805-9819-4a9f-8689-84e7e2808e72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:56.141638 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00560805-9819-4a9f-8689-84e7e2808e72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:56.318503 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-00560805-9819-4a9f-8689-84e7e2808e72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:56.330844 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-00560805-9819-4a9f-8689-84e7e2808e72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:56.332786 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-00560805-9819-4a9f-8689-84e7e2808e72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:56.335079 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-00560805-9819-4a9f-8689-84e7e2808e72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1749 microversion: 2.20 time: 0.207596 Dec 15 14:08:56.336772 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 375/743] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:56 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1749 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:56.433229 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-51fdb64c-1ba5-4172-b9ef-75c83bb5534b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:56.434091 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-51fdb64c-1ba5-4172-b9ef-75c83bb5534b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:56.441556 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-51fdb64c-1ba5-4172-b9ef-75c83bb5534b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:56.442146 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-51fdb64c-1ba5-4172-b9ef-75c83bb5534b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:56.443354 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-51fdb64c-1ba5-4172-b9ef-75c83bb5534b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:56.443659 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-51fdb64c-1ba5-4172-b9ef-75c83bb5534b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:56.599045 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-51fdb64c-1ba5-4172-b9ef-75c83bb5534b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:56.607782 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-51fdb64c-1ba5-4172-b9ef-75c83bb5534b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.179072 Dec 15 14:08:56.608372 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 369/744] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:56 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:56.747235 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-55f7655e-8863-465d-bb66-ca4146f973c4 req-e8ed3223-81ac-4175-9706-02b13f40987c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc65306-f419-4eac-97a2-407c5d6744da", "name": "network-vif-unplugged", "status": "completed", "tag": "7989001b-405b-4c40-b4ff-1aeb457e4e50"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:08:56.748849 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:08:56.748849 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:08:56.756877 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-55f7655e-8863-465d-bb66-ca4146f973c4 req-e8ed3223-81ac-4175-9706-02b13f40987c service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:56.757329 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-55f7655e-8863-465d-bb66-ca4146f973c4 req-e8ed3223-81ac-4175-9706-02b13f40987c service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:56.770143 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.compute.server_external_events [req-55f7655e-8863-465d-bb66-ca4146f973c4 req-e8ed3223-81ac-4175-9706-02b13f40987c service nova] Unable to find a host for instance fcc65306-f419-4eac-97a2-407c5d6744da. Dropping event network-vif-unplugged {{(pid=116103) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 15 14:08:56.771095 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-55f7655e-8863-465d-bb66-ca4146f973c4 req-e8ed3223-81ac-4175-9706-02b13f40987c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027736 Dec 15 14:08:56.771699 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 376/745] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:08:56 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 15 14:08:57.360153 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-36b0a36b-d42d-4b87-b4d1-b16297df1397 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:57.360785 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-36b0a36b-d42d-4b87-b4d1-b16297df1397 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:57.367639 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-36b0a36b-d42d-4b87-b4d1-b16297df1397 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:57.368103 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-36b0a36b-d42d-4b87-b4d1-b16297df1397 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:57.369092 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-36b0a36b-d42d-4b87-b4d1-b16297df1397 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:57.369522 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-36b0a36b-d42d-4b87-b4d1-b16297df1397 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:57.522014 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-36b0a36b-d42d-4b87-b4d1-b16297df1397 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:57.530610 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-36b0a36b-d42d-4b87-b4d1-b16297df1397 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:57.532104 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-36b0a36b-d42d-4b87-b4d1-b16297df1397 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:57.533260 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-36b0a36b-d42d-4b87-b4d1-b16297df1397 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.176790 Dec 15 14:08:57.533830 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 370/746] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:57 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:57.630280 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2341e402-2165-4542-a034-85072a9c503b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:57.631318 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2341e402-2165-4542-a034-85072a9c503b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:57.642832 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2341e402-2165-4542-a034-85072a9c503b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:57.643576 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2341e402-2165-4542-a034-85072a9c503b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:57.644863 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2341e402-2165-4542-a034-85072a9c503b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:57.645595 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2341e402-2165-4542-a034-85072a9c503b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:57.800072 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2341e402-2165-4542-a034-85072a9c503b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:57.808360 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2341e402-2165-4542-a034-85072a9c503b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.184243 Dec 15 14:08:57.808964 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 377/747] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:57 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:58.551515 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fd75df03-b23f-4b82-a250-310213259e1d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:58.552385 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fd75df03-b23f-4b82-a250-310213259e1d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:58.559357 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd75df03-b23f-4b82-a250-310213259e1d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:58.559797 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd75df03-b23f-4b82-a250-310213259e1d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:58.560558 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd75df03-b23f-4b82-a250-310213259e1d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:58.560986 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd75df03-b23f-4b82-a250-310213259e1d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:58.693802 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fd75df03-b23f-4b82-a250-310213259e1d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:58.702553 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fd75df03-b23f-4b82-a250-310213259e1d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:58.704087 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fd75df03-b23f-4b82-a250-310213259e1d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:58.705234 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fd75df03-b23f-4b82-a250-310213259e1d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.157476 Dec 15 14:08:58.705825 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 371/748] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:58 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:58.828390 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4b609494-4463-4dbc-b10f-f95d71c2c243 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:58.829019 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4b609494-4463-4dbc-b10f-f95d71c2c243 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:58.838108 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b609494-4463-4dbc-b10f-f95d71c2c243 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:58.838572 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b609494-4463-4dbc-b10f-f95d71c2c243 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:58.839351 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b609494-4463-4dbc-b10f-f95d71c2c243 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:58.839782 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b609494-4463-4dbc-b10f-f95d71c2c243 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:58.991871 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4b609494-4463-4dbc-b10f-f95d71c2c243 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:59.000737 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4b609494-4463-4dbc-b10f-f95d71c2c243 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.178339 Dec 15 14:08:59.001364 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 378/749] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:08:58 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:59.727957 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-022668de-aa42-47f3-aa8a-5c1eedf7e5ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:59.729133 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-022668de-aa42-47f3-aa8a-5c1eedf7e5ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:08:59.740132 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-022668de-aa42-47f3-aa8a-5c1eedf7e5ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:59.740869 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-022668de-aa42-47f3-aa8a-5c1eedf7e5ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:59.742192 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-022668de-aa42-47f3-aa8a-5c1eedf7e5ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:08:59.743259 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-022668de-aa42-47f3-aa8a-5c1eedf7e5ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:08:59.896233 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-022668de-aa42-47f3-aa8a-5c1eedf7e5ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:59.905518 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-022668de-aa42-47f3-aa8a-5c1eedf7e5ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:59.907053 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-022668de-aa42-47f3-aa8a-5c1eedf7e5ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:08:59.908235 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-022668de-aa42-47f3-aa8a-5c1eedf7e5ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.187243 Dec 15 14:08:59.908794 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 372/750] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:08:59 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:00.027139 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-63297e16-8c2b-4cbb-ad68-f23223fd653a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:00.028139 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-63297e16-8c2b-4cbb-ad68-f23223fd653a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:00.039029 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63297e16-8c2b-4cbb-ad68-f23223fd653a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:00.039765 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63297e16-8c2b-4cbb-ad68-f23223fd653a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:00.040547 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63297e16-8c2b-4cbb-ad68-f23223fd653a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:00.040984 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63297e16-8c2b-4cbb-ad68-f23223fd653a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:00.394347 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-63297e16-8c2b-4cbb-ad68-f23223fd653a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:00.404237 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-63297e16-8c2b-4cbb-ad68-f23223fd653a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.383266 Dec 15 14:09:00.404837 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 379/751] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:00 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:00.929590 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4023aaef-a919-46e9-9937-e26814581642 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:00.930336 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4023aaef-a919-46e9-9937-e26814581642 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:00.939483 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4023aaef-a919-46e9-9937-e26814581642 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:00.940091 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4023aaef-a919-46e9-9937-e26814581642 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:00.941134 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4023aaef-a919-46e9-9937-e26814581642 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:00.941766 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4023aaef-a919-46e9-9937-e26814581642 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:01.093770 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4023aaef-a919-46e9-9937-e26814581642 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:01.107347 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4023aaef-a919-46e9-9937-e26814581642 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:01.109638 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4023aaef-a919-46e9-9937-e26814581642 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:01.111417 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4023aaef-a919-46e9-9937-e26814581642 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.186622 Dec 15 14:09:01.112175 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 373/752] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:00 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:01.423004 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-173bf5b0-5426-4b75-bfd9-1660739cdb94 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:01.423865 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-173bf5b0-5426-4b75-bfd9-1660739cdb94 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:01.433309 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-173bf5b0-5426-4b75-bfd9-1660739cdb94 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:01.434011 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-173bf5b0-5426-4b75-bfd9-1660739cdb94 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:01.435250 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-173bf5b0-5426-4b75-bfd9-1660739cdb94 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:01.435874 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-173bf5b0-5426-4b75-bfd9-1660739cdb94 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:01.585463 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-173bf5b0-5426-4b75-bfd9-1660739cdb94 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:01.597820 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-173bf5b0-5426-4b75-bfd9-1660739cdb94 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.179818 Dec 15 14:09:01.598501 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 380/753] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:01 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:02.134473 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d0279b47-8e1b-42dc-bda1-8f9ecd34b205 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:02.135545 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d0279b47-8e1b-42dc-bda1-8f9ecd34b205 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:02.142683 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0279b47-8e1b-42dc-bda1-8f9ecd34b205 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:02.143140 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0279b47-8e1b-42dc-bda1-8f9ecd34b205 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:02.143922 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0279b47-8e1b-42dc-bda1-8f9ecd34b205 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:02.144360 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0279b47-8e1b-42dc-bda1-8f9ecd34b205 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:02.289075 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d0279b47-8e1b-42dc-bda1-8f9ecd34b205 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:02.299336 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d0279b47-8e1b-42dc-bda1-8f9ecd34b205 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:02.300828 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d0279b47-8e1b-42dc-bda1-8f9ecd34b205 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:02.302016 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d0279b47-8e1b-42dc-bda1-8f9ecd34b205 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.174035 Dec 15 14:09:02.302600 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 374/754] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:02 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:02.621518 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-05cc38e9-0a73-4d85-b022-434758d34ea7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:02.622198 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-05cc38e9-0a73-4d85-b022-434758d34ea7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:02.629760 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-05cc38e9-0a73-4d85-b022-434758d34ea7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:02.630263 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-05cc38e9-0a73-4d85-b022-434758d34ea7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:02.631137 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-05cc38e9-0a73-4d85-b022-434758d34ea7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:02.631656 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-05cc38e9-0a73-4d85-b022-434758d34ea7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:02.775982 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-05cc38e9-0a73-4d85-b022-434758d34ea7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:02.784691 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-05cc38e9-0a73-4d85-b022-434758d34ea7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.169381 Dec 15 14:09:02.785339 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 381/755] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:02 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:03.325561 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-99ff0dab-9b47-40d4-bd6b-0083d882a763 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:03.326703 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-99ff0dab-9b47-40d4-bd6b-0083d882a763 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:03.337376 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99ff0dab-9b47-40d4-bd6b-0083d882a763 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:03.338184 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99ff0dab-9b47-40d4-bd6b-0083d882a763 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:03.339452 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99ff0dab-9b47-40d4-bd6b-0083d882a763 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:03.339917 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99ff0dab-9b47-40d4-bd6b-0083d882a763 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:03.488405 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-99ff0dab-9b47-40d4-bd6b-0083d882a763 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:03.498525 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-99ff0dab-9b47-40d4-bd6b-0083d882a763 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:03.500085 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-99ff0dab-9b47-40d4-bd6b-0083d882a763 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:03.501252 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-99ff0dab-9b47-40d4-bd6b-0083d882a763 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.182227 Dec 15 14:09:03.501848 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 375/756] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:03 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:03.802577 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-95297fc3-c572-4ce2-8638-755d515c3033 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:03.803289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-95297fc3-c572-4ce2-8638-755d515c3033 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:03.810974 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-95297fc3-c572-4ce2-8638-755d515c3033 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:03.811426 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-95297fc3-c572-4ce2-8638-755d515c3033 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:03.812222 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-95297fc3-c572-4ce2-8638-755d515c3033 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:03.812651 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-95297fc3-c572-4ce2-8638-755d515c3033 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:03.950839 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-95297fc3-c572-4ce2-8638-755d515c3033 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:03.958404 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-95297fc3-c572-4ce2-8638-755d515c3033 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.159726 Dec 15 14:09:03.958978 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 382/757] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:03 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:04.519816 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b03bb55d-86f9-4677-878f-30e57fc1a638 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:04.520376 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b03bb55d-86f9-4677-878f-30e57fc1a638 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:04.526967 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b03bb55d-86f9-4677-878f-30e57fc1a638 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:04.527411 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b03bb55d-86f9-4677-878f-30e57fc1a638 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:04.528173 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b03bb55d-86f9-4677-878f-30e57fc1a638 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:04.528601 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b03bb55d-86f9-4677-878f-30e57fc1a638 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:04.674297 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b03bb55d-86f9-4677-878f-30e57fc1a638 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:04.687183 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b03bb55d-86f9-4677-878f-30e57fc1a638 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:04.689584 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b03bb55d-86f9-4677-878f-30e57fc1a638 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:04.691391 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b03bb55d-86f9-4677-878f-30e57fc1a638 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.175040 Dec 15 14:09:04.692303 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 376/758] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:04 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:04.984825 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-70ca7a69-e3ef-4f21-8d52-4e6a7b90f379 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:04.985821 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-70ca7a69-e3ef-4f21-8d52-4e6a7b90f379 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:04.995946 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70ca7a69-e3ef-4f21-8d52-4e6a7b90f379 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:04.996389 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70ca7a69-e3ef-4f21-8d52-4e6a7b90f379 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:04.997168 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70ca7a69-e3ef-4f21-8d52-4e6a7b90f379 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:04.997669 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70ca7a69-e3ef-4f21-8d52-4e6a7b90f379 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:05.135413 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-70ca7a69-e3ef-4f21-8d52-4e6a7b90f379 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:05.143574 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-70ca7a69-e3ef-4f21-8d52-4e6a7b90f379 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.165326 Dec 15 14:09:05.144153 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 383/759] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:04 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:05.716036 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-287f1319-e74f-4fdb-bbd1-af58b482be8b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:05.716662 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-287f1319-e74f-4fdb-bbd1-af58b482be8b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:05.723314 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-287f1319-e74f-4fdb-bbd1-af58b482be8b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:05.723779 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-287f1319-e74f-4fdb-bbd1-af58b482be8b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:05.724567 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-287f1319-e74f-4fdb-bbd1-af58b482be8b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:05.725318 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-287f1319-e74f-4fdb-bbd1-af58b482be8b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:05.864133 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-287f1319-e74f-4fdb-bbd1-af58b482be8b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:05.877456 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-287f1319-e74f-4fdb-bbd1-af58b482be8b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:05.879862 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-287f1319-e74f-4fdb-bbd1-af58b482be8b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:05.881348 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-287f1319-e74f-4fdb-bbd1-af58b482be8b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.171478 Dec 15 14:09:05.881952 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 377/760] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:05 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:06.165302 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-de5b7fbf-9f23-4d8c-a682-4d87b3f1f76f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:06.166381 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-de5b7fbf-9f23-4d8c-a682-4d87b3f1f76f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:06.174157 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-de5b7fbf-9f23-4d8c-a682-4d87b3f1f76f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:06.174609 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-de5b7fbf-9f23-4d8c-a682-4d87b3f1f76f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:06.175460 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-de5b7fbf-9f23-4d8c-a682-4d87b3f1f76f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:06.175922 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-de5b7fbf-9f23-4d8c-a682-4d87b3f1f76f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:06.325512 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-de5b7fbf-9f23-4d8c-a682-4d87b3f1f76f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:06.336533 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-de5b7fbf-9f23-4d8c-a682-4d87b3f1f76f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.177700 Dec 15 14:09:06.337246 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 384/761] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:06 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:06.903712 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c980765e-e04f-491d-a80c-8ee8c5bbc89c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:06.904800 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c980765e-e04f-491d-a80c-8ee8c5bbc89c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:06.915864 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c980765e-e04f-491d-a80c-8ee8c5bbc89c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:06.916599 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c980765e-e04f-491d-a80c-8ee8c5bbc89c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:06.917910 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c980765e-e04f-491d-a80c-8ee8c5bbc89c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:06.918737 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c980765e-e04f-491d-a80c-8ee8c5bbc89c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:07.055721 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c980765e-e04f-491d-a80c-8ee8c5bbc89c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:07.064273 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c980765e-e04f-491d-a80c-8ee8c5bbc89c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:07.065775 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c980765e-e04f-491d-a80c-8ee8c5bbc89c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:07.066945 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c980765e-e04f-491d-a80c-8ee8c5bbc89c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.169555 Dec 15 14:09:07.067495 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 378/762] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:06 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:07.355383 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a4e604af-ecd9-4e84-97d1-1ced7057657b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:07.356344 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a4e604af-ecd9-4e84-97d1-1ced7057657b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:07.363288 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a4e604af-ecd9-4e84-97d1-1ced7057657b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:07.363748 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a4e604af-ecd9-4e84-97d1-1ced7057657b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:07.364536 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a4e604af-ecd9-4e84-97d1-1ced7057657b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:07.364977 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a4e604af-ecd9-4e84-97d1-1ced7057657b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:07.506642 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a4e604af-ecd9-4e84-97d1-1ced7057657b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:07.515285 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a4e604af-ecd9-4e84-97d1-1ced7057657b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.165185 Dec 15 14:09:07.515842 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 385/763] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:07 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:08.085858 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-14173d20-6252-46d5-91f1-99e8b1210c51 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:08.086469 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-14173d20-6252-46d5-91f1-99e8b1210c51 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:08.093890 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-14173d20-6252-46d5-91f1-99e8b1210c51 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:08.094220 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-14173d20-6252-46d5-91f1-99e8b1210c51 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:08.094982 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-14173d20-6252-46d5-91f1-99e8b1210c51 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:08.095434 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-14173d20-6252-46d5-91f1-99e8b1210c51 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:08.248052 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-14173d20-6252-46d5-91f1-99e8b1210c51 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:08.261816 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-14173d20-6252-46d5-91f1-99e8b1210c51 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:08.263658 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-14173d20-6252-46d5-91f1-99e8b1210c51 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:08.264800 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-14173d20-6252-46d5-91f1-99e8b1210c51 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.182892 Dec 15 14:09:08.265355 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 379/764] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:08 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:09:08.534071 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-63360de4-0a26-44a9-8822-8552c8e76f3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:08.534715 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-63360de4-0a26-44a9-8822-8552c8e76f3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:08.542404 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63360de4-0a26-44a9-8822-8552c8e76f3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:08.542910 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63360de4-0a26-44a9-8822-8552c8e76f3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:08.543777 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63360de4-0a26-44a9-8822-8552c8e76f3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:08.544266 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63360de4-0a26-44a9-8822-8552c8e76f3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:08.685391 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-63360de4-0a26-44a9-8822-8552c8e76f3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:08.692951 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-63360de4-0a26-44a9-8822-8552c8e76f3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.163199 Dec 15 14:09:08.693570 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 386/765] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:08 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:09.286974 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cd17007b-a724-4624-b236-2ee528a5ac7a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:09.287994 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cd17007b-a724-4624-b236-2ee528a5ac7a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:09.298859 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd17007b-a724-4624-b236-2ee528a5ac7a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:09.299560 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd17007b-a724-4624-b236-2ee528a5ac7a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:09.300886 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd17007b-a724-4624-b236-2ee528a5ac7a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:09.301662 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd17007b-a724-4624-b236-2ee528a5ac7a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:09.478531 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cd17007b-a724-4624-b236-2ee528a5ac7a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:09.491776 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cd17007b-a724-4624-b236-2ee528a5ac7a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:09.494253 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cd17007b-a724-4624-b236-2ee528a5ac7a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:09.495974 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cd17007b-a724-4624-b236-2ee528a5ac7a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.214938 Dec 15 14:09:09.496677 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 380/766] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:09 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:09.713949 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-26763b8f-355c-41b9-bba5-e982f0087347 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:09.714854 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-26763b8f-355c-41b9-bba5-e982f0087347 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:09.726256 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-26763b8f-355c-41b9-bba5-e982f0087347 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:09.727008 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-26763b8f-355c-41b9-bba5-e982f0087347 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:09.728569 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-26763b8f-355c-41b9-bba5-e982f0087347 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:09.729033 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-26763b8f-355c-41b9-bba5-e982f0087347 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:09.873854 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-26763b8f-355c-41b9-bba5-e982f0087347 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:09.887338 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-26763b8f-355c-41b9-bba5-e982f0087347 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.179358 Dec 15 14:09:09.887908 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 387/767] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:09 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:10.515333 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-664e8b87-d242-44ec-9fcd-da421d0b593c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:10.515993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-664e8b87-d242-44ec-9fcd-da421d0b593c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:10.522674 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-664e8b87-d242-44ec-9fcd-da421d0b593c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:10.523130 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-664e8b87-d242-44ec-9fcd-da421d0b593c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:10.523920 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-664e8b87-d242-44ec-9fcd-da421d0b593c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:10.524356 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-664e8b87-d242-44ec-9fcd-da421d0b593c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:10.664329 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-664e8b87-d242-44ec-9fcd-da421d0b593c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:10.673292 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-664e8b87-d242-44ec-9fcd-da421d0b593c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:10.674814 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-664e8b87-d242-44ec-9fcd-da421d0b593c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:10.675969 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-664e8b87-d242-44ec-9fcd-da421d0b593c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.165027 Dec 15 14:09:10.676525 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 381/768] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:10 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:10.905274 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9dd02891-d7bc-4dd1-b569-a9dc05b9b8c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:10.906030 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9dd02891-d7bc-4dd1-b569-a9dc05b9b8c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:10.913046 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9dd02891-d7bc-4dd1-b569-a9dc05b9b8c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:10.913490 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9dd02891-d7bc-4dd1-b569-a9dc05b9b8c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:10.914293 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9dd02891-d7bc-4dd1-b569-a9dc05b9b8c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:10.914719 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9dd02891-d7bc-4dd1-b569-a9dc05b9b8c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:11.061860 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9dd02891-d7bc-4dd1-b569-a9dc05b9b8c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:11.074462 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9dd02891-d7bc-4dd1-b569-a9dc05b9b8c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.172994 Dec 15 14:09:11.075202 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 388/769] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:10 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:11.703967 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-501d7cea-0048-4bca-8a39-fe164b95ad3b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:11.704903 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-501d7cea-0048-4bca-8a39-fe164b95ad3b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:11.716041 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-501d7cea-0048-4bca-8a39-fe164b95ad3b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:11.716493 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-501d7cea-0048-4bca-8a39-fe164b95ad3b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:11.717307 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-501d7cea-0048-4bca-8a39-fe164b95ad3b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:11.717817 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-501d7cea-0048-4bca-8a39-fe164b95ad3b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:11.868462 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-501d7cea-0048-4bca-8a39-fe164b95ad3b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:11.876286 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-501d7cea-0048-4bca-8a39-fe164b95ad3b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:11.878887 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-501d7cea-0048-4bca-8a39-fe164b95ad3b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:11.880676 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-501d7cea-0048-4bca-8a39-fe164b95ad3b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.182823 Dec 15 14:09:11.881471 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 382/770] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:11 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:12.096791 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e4293d2f-91f1-4e70-afcd-8351515c570b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:12.097993 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e4293d2f-91f1-4e70-afcd-8351515c570b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:12.108468 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4293d2f-91f1-4e70-afcd-8351515c570b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:12.108910 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4293d2f-91f1-4e70-afcd-8351515c570b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:12.109708 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4293d2f-91f1-4e70-afcd-8351515c570b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:12.110139 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4293d2f-91f1-4e70-afcd-8351515c570b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:12.259095 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e4293d2f-91f1-4e70-afcd-8351515c570b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:12.267159 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e4293d2f-91f1-4e70-afcd-8351515c570b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.177372 Dec 15 14:09:12.267740 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 389/771] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:12 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:12.903511 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-be05ee94-7252-44af-b9af-acd81efdb3ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:12.904155 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-be05ee94-7252-44af-b9af-acd81efdb3ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:12.910879 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-be05ee94-7252-44af-b9af-acd81efdb3ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:12.911409 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-be05ee94-7252-44af-b9af-acd81efdb3ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:12.912200 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-be05ee94-7252-44af-b9af-acd81efdb3ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:12.912641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-be05ee94-7252-44af-b9af-acd81efdb3ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:13.061450 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-be05ee94-7252-44af-b9af-acd81efdb3ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:13.071902 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-be05ee94-7252-44af-b9af-acd81efdb3ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:13.073394 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-be05ee94-7252-44af-b9af-acd81efdb3ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:13.074587 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-be05ee94-7252-44af-b9af-acd81efdb3ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.176197 Dec 15 14:09:13.075193 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 383/772] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:12 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:13.289295 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4e41c522-e014-4209-821a-42d9367cbf62 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:13.290331 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4e41c522-e014-4209-821a-42d9367cbf62 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:13.299159 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4e41c522-e014-4209-821a-42d9367cbf62 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:13.299599 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4e41c522-e014-4209-821a-42d9367cbf62 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:13.300418 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4e41c522-e014-4209-821a-42d9367cbf62 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:13.300853 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4e41c522-e014-4209-821a-42d9367cbf62 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:13.446044 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4e41c522-e014-4209-821a-42d9367cbf62 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:13.456434 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4e41c522-e014-4209-821a-42d9367cbf62 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.173183 Dec 15 14:09:13.457019 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 390/773] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:13 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:14.098781 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e8d1654e-0eaa-487b-9861-dd8e687fad4b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:14.100117 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e8d1654e-0eaa-487b-9861-dd8e687fad4b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:14.110544 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8d1654e-0eaa-487b-9861-dd8e687fad4b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:14.111004 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8d1654e-0eaa-487b-9861-dd8e687fad4b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:14.111775 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8d1654e-0eaa-487b-9861-dd8e687fad4b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:14.112213 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8d1654e-0eaa-487b-9861-dd8e687fad4b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:14.257561 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e8d1654e-0eaa-487b-9861-dd8e687fad4b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:14.267211 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e8d1654e-0eaa-487b-9861-dd8e687fad4b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:14.268713 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e8d1654e-0eaa-487b-9861-dd8e687fad4b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:14.269943 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e8d1654e-0eaa-487b-9861-dd8e687fad4b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.178190 Dec 15 14:09:14.270512 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 384/774] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:14 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:09:14.473568 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1f28ab29-5682-4213-a4d8-01d64dba3659 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:14.474176 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1f28ab29-5682-4213-a4d8-01d64dba3659 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:14.481516 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1f28ab29-5682-4213-a4d8-01d64dba3659 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:14.481997 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1f28ab29-5682-4213-a4d8-01d64dba3659 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:14.482927 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1f28ab29-5682-4213-a4d8-01d64dba3659 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:14.483372 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1f28ab29-5682-4213-a4d8-01d64dba3659 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:14.631922 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1f28ab29-5682-4213-a4d8-01d64dba3659 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:14.644535 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1f28ab29-5682-4213-a4d8-01d64dba3659 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.174451 Dec 15 14:09:14.645420 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 391/775] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:14 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:15.293402 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fbe82d10-37aa-4620-86bf-e155bec01d84 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:15.294420 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fbe82d10-37aa-4620-86bf-e155bec01d84 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:15.305260 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fbe82d10-37aa-4620-86bf-e155bec01d84 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:15.306069 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fbe82d10-37aa-4620-86bf-e155bec01d84 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:15.307353 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fbe82d10-37aa-4620-86bf-e155bec01d84 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:15.308079 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fbe82d10-37aa-4620-86bf-e155bec01d84 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:15.448755 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fbe82d10-37aa-4620-86bf-e155bec01d84 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:15.458419 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fbe82d10-37aa-4620-86bf-e155bec01d84 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:15.459896 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fbe82d10-37aa-4620-86bf-e155bec01d84 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:15.461087 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fbe82d10-37aa-4620-86bf-e155bec01d84 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.174196 Dec 15 14:09:15.461886 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 385/776] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:15 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:15.666828 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-90f5ff9e-a303-40ce-8daa-d423d6b72e6b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:15.667432 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-90f5ff9e-a303-40ce-8daa-d423d6b72e6b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:15.674475 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90f5ff9e-a303-40ce-8daa-d423d6b72e6b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:15.675046 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90f5ff9e-a303-40ce-8daa-d423d6b72e6b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:15.675717 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90f5ff9e-a303-40ce-8daa-d423d6b72e6b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:15.676155 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90f5ff9e-a303-40ce-8daa-d423d6b72e6b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:15.817465 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90f5ff9e-a303-40ce-8daa-d423d6b72e6b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:15.825117 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-90f5ff9e-a303-40ce-8daa-d423d6b72e6b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.161986 Dec 15 14:09:15.825685 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 392/777] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:15 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:16.479925 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b83f5f96-f811-455b-b542-55d57f50bd2c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:16.480557 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b83f5f96-f811-455b-b542-55d57f50bd2c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:16.487970 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b83f5f96-f811-455b-b542-55d57f50bd2c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:16.488417 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b83f5f96-f811-455b-b542-55d57f50bd2c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:16.489198 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b83f5f96-f811-455b-b542-55d57f50bd2c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:16.489652 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b83f5f96-f811-455b-b542-55d57f50bd2c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:16.637559 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b83f5f96-f811-455b-b542-55d57f50bd2c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:16.646395 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b83f5f96-f811-455b-b542-55d57f50bd2c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:16.647905 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b83f5f96-f811-455b-b542-55d57f50bd2c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:16.649076 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b83f5f96-f811-455b-b542-55d57f50bd2c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.172817 Dec 15 14:09:16.649653 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 386/778] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:16 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:16.842682 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-af8793b0-4538-488e-943c-ef2b55319011 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:16.843279 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-af8793b0-4538-488e-943c-ef2b55319011 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:16.851205 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af8793b0-4538-488e-943c-ef2b55319011 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:16.852013 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af8793b0-4538-488e-943c-ef2b55319011 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:16.853343 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af8793b0-4538-488e-943c-ef2b55319011 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:16.854132 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af8793b0-4538-488e-943c-ef2b55319011 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:17.011297 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-af8793b0-4538-488e-943c-ef2b55319011 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:17.021397 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-af8793b0-4538-488e-943c-ef2b55319011 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.182528 Dec 15 14:09:17.022191 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 393/779] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:16 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:09:17.672152 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1e35d58a-ff15-4b91-82ba-f92a0563a6bb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:17.673141 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1e35d58a-ff15-4b91-82ba-f92a0563a6bb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:17.684798 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e35d58a-ff15-4b91-82ba-f92a0563a6bb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:17.685745 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e35d58a-ff15-4b91-82ba-f92a0563a6bb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:17.687467 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e35d58a-ff15-4b91-82ba-f92a0563a6bb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:17.688366 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e35d58a-ff15-4b91-82ba-f92a0563a6bb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:17.836454 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1e35d58a-ff15-4b91-82ba-f92a0563a6bb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:17.845176 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1e35d58a-ff15-4b91-82ba-f92a0563a6bb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:17.847877 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1e35d58a-ff15-4b91-82ba-f92a0563a6bb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:17.849050 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1e35d58a-ff15-4b91-82ba-f92a0563a6bb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.183146 Dec 15 14:09:17.849587 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 387/780] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:17 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:18.041540 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-812c1319-ba35-49db-9df1-54e71466b4e8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:18.042297 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-812c1319-ba35-49db-9df1-54e71466b4e8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:18.050723 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-812c1319-ba35-49db-9df1-54e71466b4e8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:18.051168 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-812c1319-ba35-49db-9df1-54e71466b4e8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:18.051949 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-812c1319-ba35-49db-9df1-54e71466b4e8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:18.052379 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-812c1319-ba35-49db-9df1-54e71466b4e8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:18.200429 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-812c1319-ba35-49db-9df1-54e71466b4e8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:18.207994 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-812c1319-ba35-49db-9df1-54e71466b4e8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.171604 Dec 15 14:09:18.208576 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 394/781] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:18 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:18.872572 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-08f74eec-7226-43be-9e00-8de0f2b9a5b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:18.873582 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-08f74eec-7226-43be-9e00-8de0f2b9a5b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:18.881315 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-08f74eec-7226-43be-9e00-8de0f2b9a5b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:18.881813 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-08f74eec-7226-43be-9e00-8de0f2b9a5b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:18.882604 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-08f74eec-7226-43be-9e00-8de0f2b9a5b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:18.883014 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-08f74eec-7226-43be-9e00-8de0f2b9a5b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:19.027970 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-08f74eec-7226-43be-9e00-8de0f2b9a5b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:19.036734 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-08f74eec-7226-43be-9e00-8de0f2b9a5b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:19.038282 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-08f74eec-7226-43be-9e00-8de0f2b9a5b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:19.039460 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-08f74eec-7226-43be-9e00-8de0f2b9a5b6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.173498 Dec 15 14:09:19.040014 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 388/782] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:18 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:19.225841 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c0592c63-8911-4295-aa10-a87e468ce9d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:19.226525 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c0592c63-8911-4295-aa10-a87e468ce9d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:19.233482 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0592c63-8911-4295-aa10-a87e468ce9d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:19.233959 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0592c63-8911-4295-aa10-a87e468ce9d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:19.234750 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0592c63-8911-4295-aa10-a87e468ce9d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:19.235177 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0592c63-8911-4295-aa10-a87e468ce9d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:19.374210 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c0592c63-8911-4295-aa10-a87e468ce9d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:19.382525 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c0592c63-8911-4295-aa10-a87e468ce9d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.160777 Dec 15 14:09:19.383076 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 395/783] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:19 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:20.062675 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-781edbdd-780d-41fe-adcc-b9650242930e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:20.063504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-781edbdd-780d-41fe-adcc-b9650242930e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:20.075491 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-781edbdd-780d-41fe-adcc-b9650242930e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:20.076264 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-781edbdd-780d-41fe-adcc-b9650242930e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:20.077584 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-781edbdd-780d-41fe-adcc-b9650242930e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:20.078387 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-781edbdd-780d-41fe-adcc-b9650242930e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:20.217924 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-781edbdd-780d-41fe-adcc-b9650242930e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:20.231240 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-781edbdd-780d-41fe-adcc-b9650242930e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:20.233492 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-781edbdd-780d-41fe-adcc-b9650242930e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:20.235220 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-781edbdd-780d-41fe-adcc-b9650242930e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.178908 Dec 15 14:09:20.235866 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 389/784] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:20 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:20.404405 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b0ff1c98-698f-4f54-b539-eb9d57f599ea tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:20.405016 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b0ff1c98-698f-4f54-b539-eb9d57f599ea tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:20.412176 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0ff1c98-698f-4f54-b539-eb9d57f599ea tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:20.412619 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0ff1c98-698f-4f54-b539-eb9d57f599ea tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:20.413393 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0ff1c98-698f-4f54-b539-eb9d57f599ea tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:20.413860 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0ff1c98-698f-4f54-b539-eb9d57f599ea tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:20.569197 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b0ff1c98-698f-4f54-b539-eb9d57f599ea tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:20.576753 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b0ff1c98-698f-4f54-b539-eb9d57f599ea tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.176129 Dec 15 14:09:20.577317 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 396/785] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:20 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:21.254696 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b9e360a8-0772-4fd5-9362-fd659e94a79b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:21.255334 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b9e360a8-0772-4fd5-9362-fd659e94a79b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:21.262140 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9e360a8-0772-4fd5-9362-fd659e94a79b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:21.262610 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9e360a8-0772-4fd5-9362-fd659e94a79b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:21.263396 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9e360a8-0772-4fd5-9362-fd659e94a79b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:21.263833 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9e360a8-0772-4fd5-9362-fd659e94a79b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:21.411143 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b9e360a8-0772-4fd5-9362-fd659e94a79b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:21.423770 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b9e360a8-0772-4fd5-9362-fd659e94a79b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:21.425989 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b9e360a8-0772-4fd5-9362-fd659e94a79b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:21.427202 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b9e360a8-0772-4fd5-9362-fd659e94a79b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.176535 Dec 15 14:09:21.427767 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 390/786] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:21 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:21.594109 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4290aef1-6dc9-4811-8309-411573e193f6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:21.594699 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4290aef1-6dc9-4811-8309-411573e193f6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:21.602037 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4290aef1-6dc9-4811-8309-411573e193f6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:21.602486 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4290aef1-6dc9-4811-8309-411573e193f6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:21.603298 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4290aef1-6dc9-4811-8309-411573e193f6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:21.603737 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4290aef1-6dc9-4811-8309-411573e193f6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:21.756561 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4290aef1-6dc9-4811-8309-411573e193f6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:21.764411 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4290aef1-6dc9-4811-8309-411573e193f6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.174019 Dec 15 14:09:21.765203 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 397/787] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:21 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:22.448930 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-86424739-dd29-48b7-83af-c3703c114f09 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:22.449894 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-86424739-dd29-48b7-83af-c3703c114f09 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:22.462387 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-86424739-dd29-48b7-83af-c3703c114f09 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:22.463191 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-86424739-dd29-48b7-83af-c3703c114f09 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:22.464495 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-86424739-dd29-48b7-83af-c3703c114f09 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:22.465196 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-86424739-dd29-48b7-83af-c3703c114f09 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:22.611695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-86424739-dd29-48b7-83af-c3703c114f09 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:22.620857 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-86424739-dd29-48b7-83af-c3703c114f09 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:22.622329 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-86424739-dd29-48b7-83af-c3703c114f09 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:22.623499 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-86424739-dd29-48b7-83af-c3703c114f09 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.180977 Dec 15 14:09:22.624066 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 391/788] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:22 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:22.782489 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6313a9f2-601f-468d-bb73-1df78d5c2d8f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:22.783182 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6313a9f2-601f-468d-bb73-1df78d5c2d8f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:22.790319 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6313a9f2-601f-468d-bb73-1df78d5c2d8f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:22.790780 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6313a9f2-601f-468d-bb73-1df78d5c2d8f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:22.791590 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6313a9f2-601f-468d-bb73-1df78d5c2d8f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:22.792024 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6313a9f2-601f-468d-bb73-1df78d5c2d8f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:22.933888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6313a9f2-601f-468d-bb73-1df78d5c2d8f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:22.941751 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6313a9f2-601f-468d-bb73-1df78d5c2d8f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.163054 Dec 15 14:09:22.942460 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 398/789] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:22 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:23.646468 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e0a55752-61ea-4e8c-bb59-7092f19d5f86 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:23.647094 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e0a55752-61ea-4e8c-bb59-7092f19d5f86 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:23.654410 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e0a55752-61ea-4e8c-bb59-7092f19d5f86 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:23.654867 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e0a55752-61ea-4e8c-bb59-7092f19d5f86 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:23.655688 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e0a55752-61ea-4e8c-bb59-7092f19d5f86 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:23.656141 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e0a55752-61ea-4e8c-bb59-7092f19d5f86 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:23.805295 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e0a55752-61ea-4e8c-bb59-7092f19d5f86 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:23.813625 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e0a55752-61ea-4e8c-bb59-7092f19d5f86 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:23.815142 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e0a55752-61ea-4e8c-bb59-7092f19d5f86 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:23.816341 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e0a55752-61ea-4e8c-bb59-7092f19d5f86 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.176492 Dec 15 14:09:23.817191 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 392/790] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:23 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:23.958990 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a2064df3-ae6c-462e-9ed5-7245ba67c093 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:23.959538 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a2064df3-ae6c-462e-9ed5-7245ba67c093 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:23.966613 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2064df3-ae6c-462e-9ed5-7245ba67c093 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:23.967067 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2064df3-ae6c-462e-9ed5-7245ba67c093 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:23.967870 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2064df3-ae6c-462e-9ed5-7245ba67c093 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:23.968291 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2064df3-ae6c-462e-9ed5-7245ba67c093 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:24.113254 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a2064df3-ae6c-462e-9ed5-7245ba67c093 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:24.120616 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a2064df3-ae6c-462e-9ed5-7245ba67c093 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.165479 Dec 15 14:09:24.121154 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 399/791] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:23 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:24.837233 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-db2251e8-64c4-407b-a5f7-4510c1ac1af5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:24.837904 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-db2251e8-64c4-407b-a5f7-4510c1ac1af5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:24.844814 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db2251e8-64c4-407b-a5f7-4510c1ac1af5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:24.845264 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db2251e8-64c4-407b-a5f7-4510c1ac1af5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:24.846091 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db2251e8-64c4-407b-a5f7-4510c1ac1af5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:24.846598 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db2251e8-64c4-407b-a5f7-4510c1ac1af5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:24.988329 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-db2251e8-64c4-407b-a5f7-4510c1ac1af5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:24.996527 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-db2251e8-64c4-407b-a5f7-4510c1ac1af5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:24.998228 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-db2251e8-64c4-407b-a5f7-4510c1ac1af5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:24.999308 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-db2251e8-64c4-407b-a5f7-4510c1ac1af5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.165918 Dec 15 14:09:24.999876 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 393/792] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:24 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:25.140899 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a5dfd712-8170-4eba-9fd3-f487a3381e10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:25.141862 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a5dfd712-8170-4eba-9fd3-f487a3381e10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:25.149982 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5dfd712-8170-4eba-9fd3-f487a3381e10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:25.150456 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5dfd712-8170-4eba-9fd3-f487a3381e10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:25.151221 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5dfd712-8170-4eba-9fd3-f487a3381e10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:25.151651 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5dfd712-8170-4eba-9fd3-f487a3381e10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:25.345225 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a5dfd712-8170-4eba-9fd3-f487a3381e10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:25.354000 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a5dfd712-8170-4eba-9fd3-f487a3381e10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.218574 Dec 15 14:09:25.354614 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 400/793] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:25 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:26.019622 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c809fc7b-4c2e-483d-b3b1-187706cdd992 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:26.020378 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c809fc7b-4c2e-483d-b3b1-187706cdd992 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:26.028501 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c809fc7b-4c2e-483d-b3b1-187706cdd992 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:26.028952 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c809fc7b-4c2e-483d-b3b1-187706cdd992 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:26.029753 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c809fc7b-4c2e-483d-b3b1-187706cdd992 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:26.030228 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c809fc7b-4c2e-483d-b3b1-187706cdd992 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:26.171651 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c809fc7b-4c2e-483d-b3b1-187706cdd992 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:26.181103 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c809fc7b-4c2e-483d-b3b1-187706cdd992 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:26.182668 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c809fc7b-4c2e-483d-b3b1-187706cdd992 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:26.183826 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c809fc7b-4c2e-483d-b3b1-187706cdd992 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.168078 Dec 15 14:09:26.184420 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 394/794] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:26 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:26.374674 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2bc918d8-aa1b-45d1-b5a2-108a1c2f649c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:26.375671 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2bc918d8-aa1b-45d1-b5a2-108a1c2f649c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:26.387048 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2bc918d8-aa1b-45d1-b5a2-108a1c2f649c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:26.387791 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2bc918d8-aa1b-45d1-b5a2-108a1c2f649c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:26.389110 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2bc918d8-aa1b-45d1-b5a2-108a1c2f649c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:26.389877 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2bc918d8-aa1b-45d1-b5a2-108a1c2f649c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:26.538422 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2bc918d8-aa1b-45d1-b5a2-108a1c2f649c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:26.546732 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2bc918d8-aa1b-45d1-b5a2-108a1c2f649c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.178209 Dec 15 14:09:26.547312 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 401/795] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:26 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:27.208881 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-542a8b8b-016e-40af-bcef-19ef3f673c20 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:27.209422 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-542a8b8b-016e-40af-bcef-19ef3f673c20 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:27.216478 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-542a8b8b-016e-40af-bcef-19ef3f673c20 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:27.216930 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-542a8b8b-016e-40af-bcef-19ef3f673c20 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:27.217757 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-542a8b8b-016e-40af-bcef-19ef3f673c20 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:27.218198 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-542a8b8b-016e-40af-bcef-19ef3f673c20 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:27.362992 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-542a8b8b-016e-40af-bcef-19ef3f673c20 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:27.372280 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-542a8b8b-016e-40af-bcef-19ef3f673c20 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:27.373858 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-542a8b8b-016e-40af-bcef-19ef3f673c20 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:27.375118 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-542a8b8b-016e-40af-bcef-19ef3f673c20 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.172693 Dec 15 14:09:27.375746 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 395/796] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:27 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:27.564788 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3f2ed4fd-2fcf-4b21-91eb-6e141cd8b63f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:27.565630 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3f2ed4fd-2fcf-4b21-91eb-6e141cd8b63f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:27.573125 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f2ed4fd-2fcf-4b21-91eb-6e141cd8b63f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:27.573590 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f2ed4fd-2fcf-4b21-91eb-6e141cd8b63f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:27.574415 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f2ed4fd-2fcf-4b21-91eb-6e141cd8b63f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:27.574856 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f2ed4fd-2fcf-4b21-91eb-6e141cd8b63f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:27.719642 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3f2ed4fd-2fcf-4b21-91eb-6e141cd8b63f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:27.727720 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3f2ed4fd-2fcf-4b21-91eb-6e141cd8b63f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.167555 Dec 15 14:09:27.728322 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 402/797] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:27 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:28.396056 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-77baaa07-9c15-46fd-b3d4-57f5a94b9cea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:28.396801 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-77baaa07-9c15-46fd-b3d4-57f5a94b9cea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:28.405367 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-77baaa07-9c15-46fd-b3d4-57f5a94b9cea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:28.405968 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-77baaa07-9c15-46fd-b3d4-57f5a94b9cea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:28.406933 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-77baaa07-9c15-46fd-b3d4-57f5a94b9cea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:28.407470 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-77baaa07-9c15-46fd-b3d4-57f5a94b9cea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:28.558850 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-77baaa07-9c15-46fd-b3d4-57f5a94b9cea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:28.572615 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-77baaa07-9c15-46fd-b3d4-57f5a94b9cea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:28.574991 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-77baaa07-9c15-46fd-b3d4-57f5a94b9cea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:28.576740 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-77baaa07-9c15-46fd-b3d4-57f5a94b9cea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.185402 Dec 15 14:09:28.577582 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 396/798] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:28 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:28.745517 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-10779b70-85d9-4d85-8b47-2776437bcafc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:28.746534 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-10779b70-85d9-4d85-8b47-2776437bcafc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:28.753149 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10779b70-85d9-4d85-8b47-2776437bcafc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:28.753625 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10779b70-85d9-4d85-8b47-2776437bcafc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:28.754453 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10779b70-85d9-4d85-8b47-2776437bcafc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:28.754946 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10779b70-85d9-4d85-8b47-2776437bcafc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:28.898473 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-10779b70-85d9-4d85-8b47-2776437bcafc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:28.906629 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-10779b70-85d9-4d85-8b47-2776437bcafc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.165801 Dec 15 14:09:28.907216 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 403/799] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:28 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:28.941849 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-e18bfb1f-72f5-4bed-b49f-699b6fbe5fa8 req-40e904e8-2881-4007-b1d0-a2a13c8c68ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12be41af-387a-4090-93dd-d26d8e97bf45", "name": "network-vif-plugged", "status": "completed", "tag": "ffe19195-444e-423e-ac6a-9120626e5ae8"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:09:28.943825 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:09:28.943825 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:09:28.950912 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-e18bfb1f-72f5-4bed-b49f-699b6fbe5fa8 req-40e904e8-2881-4007-b1d0-a2a13c8c68ef service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:28.951361 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-e18bfb1f-72f5-4bed-b49f-699b6fbe5fa8 req-40e904e8-2881-4007-b1d0-a2a13c8c68ef service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:28.962688 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-e18bfb1f-72f5-4bed-b49f-699b6fbe5fa8 req-40e904e8-2881-4007-b1d0-a2a13c8c68ef service nova] Creating event network-vif-plugged:ffe19195-444e-423e-ac6a-9120626e5ae8 for instance 12be41af-387a-4090-93dd-d26d8e97bf45 on hv-cinder-82182 Dec 15 14:09:28.968022 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-e18bfb1f-72f5-4bed-b49f-699b6fbe5fa8 req-40e904e8-2881-4007-b1d0-a2a13c8c68ef service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106045 Dec 15 14:09:28.968647 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 397/800] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:09:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:09:29.602083 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fc61c46d-41db-4d22-821a-04249a736ac0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:29.603379 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fc61c46d-41db-4d22-821a-04249a736ac0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:29.613188 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc61c46d-41db-4d22-821a-04249a736ac0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:29.614003 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc61c46d-41db-4d22-821a-04249a736ac0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:29.615064 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc61c46d-41db-4d22-821a-04249a736ac0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:29.615506 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc61c46d-41db-4d22-821a-04249a736ac0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:29.759789 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fc61c46d-41db-4d22-821a-04249a736ac0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:29.768974 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fc61c46d-41db-4d22-821a-04249a736ac0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:29.770603 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fc61c46d-41db-4d22-821a-04249a736ac0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:29.771949 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fc61c46d-41db-4d22-821a-04249a736ac0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.178311 Dec 15 14:09:29.772592 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 404/801] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:29 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:29.929351 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-13edbc81-270d-4f93-b581-566505b0f0e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:29.930452 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-13edbc81-270d-4f93-b581-566505b0f0e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:29.941523 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13edbc81-270d-4f93-b581-566505b0f0e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:29.942471 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13edbc81-270d-4f93-b581-566505b0f0e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:29.943233 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13edbc81-270d-4f93-b581-566505b0f0e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:29.943707 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13edbc81-270d-4f93-b581-566505b0f0e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:30.096806 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-13edbc81-270d-4f93-b581-566505b0f0e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:30.105585 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-13edbc81-270d-4f93-b581-566505b0f0e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1260 microversion: 2.1 time: 0.183186 Dec 15 14:09:30.106207 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 398/802] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:29 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:30.790845 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-897e2146-f32a-4e5f-a569-ed39c70dacd0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:30.792319 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-897e2146-f32a-4e5f-a569-ed39c70dacd0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:30.800606 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-897e2146-f32a-4e5f-a569-ed39c70dacd0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:30.801313 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-897e2146-f32a-4e5f-a569-ed39c70dacd0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:30.802435 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-897e2146-f32a-4e5f-a569-ed39c70dacd0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:30.803184 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-897e2146-f32a-4e5f-a569-ed39c70dacd0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:30.949003 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-897e2146-f32a-4e5f-a569-ed39c70dacd0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:30.958183 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-897e2146-f32a-4e5f-a569-ed39c70dacd0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:30.959678 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-897e2146-f32a-4e5f-a569-ed39c70dacd0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:30.960837 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-897e2146-f32a-4e5f-a569-ed39c70dacd0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.174645 Dec 15 14:09:30.961430 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 405/803] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:30 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:31.124535 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-83af680e-8666-4d6b-94c3-82d3dac4bdd3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:31.125292 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-83af680e-8666-4d6b-94c3-82d3dac4bdd3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:31.135253 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83af680e-8666-4d6b-94c3-82d3dac4bdd3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:31.136000 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83af680e-8666-4d6b-94c3-82d3dac4bdd3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:31.137337 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83af680e-8666-4d6b-94c3-82d3dac4bdd3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:31.138298 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83af680e-8666-4d6b-94c3-82d3dac4bdd3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:31.300837 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-83af680e-8666-4d6b-94c3-82d3dac4bdd3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:31.309052 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-83af680e-8666-4d6b-94c3-82d3dac4bdd3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1444 microversion: 2.1 time: 0.189282 Dec 15 14:09:31.309594 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 399/804] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:31 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1444 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:31.326631 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-87860fe6-f6b7-45a1-a33b-4a245596f573 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:31.326736 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-87860fe6-f6b7-45a1-a33b-4a245596f573 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:31.332734 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87860fe6-f6b7-45a1-a33b-4a245596f573 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:31.333796 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87860fe6-f6b7-45a1-a33b-4a245596f573 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:31.334297 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87860fe6-f6b7-45a1-a33b-4a245596f573 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:31.334740 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87860fe6-f6b7-45a1-a33b-4a245596f573 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:31.484296 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-87860fe6-f6b7-45a1-a33b-4a245596f573 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:31.492290 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-87860fe6-f6b7-45a1-a33b-4a245596f573 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1444 microversion: 2.1 time: 0.169812 Dec 15 14:09:31.492866 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 406/805] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:09:31 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1444 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:09:31.980648 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2177fdc5-6fea-4b81-82d5-3cf27558f7ee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:31.988746 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2177fdc5-6fea-4b81-82d5-3cf27558f7ee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:31.996369 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2177fdc5-6fea-4b81-82d5-3cf27558f7ee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:31.996820 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2177fdc5-6fea-4b81-82d5-3cf27558f7ee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:31.997637 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2177fdc5-6fea-4b81-82d5-3cf27558f7ee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:31.998155 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2177fdc5-6fea-4b81-82d5-3cf27558f7ee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:32.144660 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2177fdc5-6fea-4b81-82d5-3cf27558f7ee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:32.154247 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2177fdc5-6fea-4b81-82d5-3cf27558f7ee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:32.155743 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2177fdc5-6fea-4b81-82d5-3cf27558f7ee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:32.156933 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2177fdc5-6fea-4b81-82d5-3cf27558f7ee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.180783 Dec 15 14:09:32.157499 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 400/806] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:31 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:33.176877 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7ac087b7-7bea-46e5-afee-3a208a0816cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:33.178182 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7ac087b7-7bea-46e5-afee-3a208a0816cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:33.184940 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ac087b7-7bea-46e5-afee-3a208a0816cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:33.185392 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ac087b7-7bea-46e5-afee-3a208a0816cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:33.186236 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ac087b7-7bea-46e5-afee-3a208a0816cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:33.186674 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ac087b7-7bea-46e5-afee-3a208a0816cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:33.324375 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7ac087b7-7bea-46e5-afee-3a208a0816cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:33.332930 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7ac087b7-7bea-46e5-afee-3a208a0816cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:33.334587 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7ac087b7-7bea-46e5-afee-3a208a0816cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:33.335835 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7ac087b7-7bea-46e5-afee-3a208a0816cb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.163289 Dec 15 14:09:33.336487 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 407/807] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:33 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:33.612337 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-d817d1a7-832b-4ff4-8492-354b387b4280 req-d73ca52d-a171-4204-af43-caf7c3bf2c2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12be41af-387a-4090-93dd-d26d8e97bf45", "tag": "ffe19195-444e-423e-ac6a-9120626e5ae8"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:09:33.613985 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:09:33.613985 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:09:33.622288 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-d817d1a7-832b-4ff4-8492-354b387b4280 req-d73ca52d-a171-4204-af43-caf7c3bf2c2a service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:33.622736 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-d817d1a7-832b-4ff4-8492-354b387b4280 req-d73ca52d-a171-4204-af43-caf7c3bf2c2a service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:33.634712 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-d817d1a7-832b-4ff4-8492-354b387b4280 req-d73ca52d-a171-4204-af43-caf7c3bf2c2a service nova] Creating event network-changed:ffe19195-444e-423e-ac6a-9120626e5ae8 for instance 12be41af-387a-4090-93dd-d26d8e97bf45 on hv-cinder-82182 Dec 15 14:09:33.642270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-d817d1a7-832b-4ff4-8492-354b387b4280 req-d73ca52d-a171-4204-af43-caf7c3bf2c2a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087027 Dec 15 14:09:33.644177 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 401/808] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:09:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:09:34.354639 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3fdcce27-65a3-4eb7-b615-5303285aa3c7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:34.355252 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3fdcce27-65a3-4eb7-b615-5303285aa3c7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:34.362100 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3fdcce27-65a3-4eb7-b615-5303285aa3c7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:34.362589 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3fdcce27-65a3-4eb7-b615-5303285aa3c7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:34.363530 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3fdcce27-65a3-4eb7-b615-5303285aa3c7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:34.363851 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3fdcce27-65a3-4eb7-b615-5303285aa3c7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:34.515952 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3fdcce27-65a3-4eb7-b615-5303285aa3c7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:34.525137 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3fdcce27-65a3-4eb7-b615-5303285aa3c7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:34.527178 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3fdcce27-65a3-4eb7-b615-5303285aa3c7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:34.527830 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3fdcce27-65a3-4eb7-b615-5303285aa3c7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.177132 Dec 15 14:09:34.528400 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 408/809] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:34 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:35.547496 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dce58eae-d835-49e9-8598-a053d666d101 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:35.548262 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dce58eae-d835-49e9-8598-a053d666d101 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:35.555164 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dce58eae-d835-49e9-8598-a053d666d101 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:35.555655 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dce58eae-d835-49e9-8598-a053d666d101 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:35.556691 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dce58eae-d835-49e9-8598-a053d666d101 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:35.557753 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dce58eae-d835-49e9-8598-a053d666d101 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:35.699268 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dce58eae-d835-49e9-8598-a053d666d101 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:35.708256 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dce58eae-d835-49e9-8598-a053d666d101 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:35.709847 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dce58eae-d835-49e9-8598-a053d666d101 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:35.711277 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dce58eae-d835-49e9-8598-a053d666d101 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.168214 Dec 15 14:09:35.711838 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 402/810] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:35 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:36.733649 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7ab4a03d-de9f-48b0-ad9b-fd3277c95d07 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:36.734483 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7ab4a03d-de9f-48b0-ad9b-fd3277c95d07 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:36.744194 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ab4a03d-de9f-48b0-ad9b-fd3277c95d07 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:36.744775 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ab4a03d-de9f-48b0-ad9b-fd3277c95d07 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:36.745967 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ab4a03d-de9f-48b0-ad9b-fd3277c95d07 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:36.746693 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ab4a03d-de9f-48b0-ad9b-fd3277c95d07 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:36.890755 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7ab4a03d-de9f-48b0-ad9b-fd3277c95d07 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:36.900540 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7ab4a03d-de9f-48b0-ad9b-fd3277c95d07 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:36.902064 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7ab4a03d-de9f-48b0-ad9b-fd3277c95d07 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:36.903283 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7ab4a03d-de9f-48b0-ad9b-fd3277c95d07 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.175388 Dec 15 14:09:36.903818 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 409/811] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:36 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:37.926422 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2ab13a98-42c5-4acf-8164-42d128e0d83a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:37.927426 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2ab13a98-42c5-4acf-8164-42d128e0d83a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:37.938537 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2ab13a98-42c5-4acf-8164-42d128e0d83a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:37.939272 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2ab13a98-42c5-4acf-8164-42d128e0d83a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:37.940561 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2ab13a98-42c5-4acf-8164-42d128e0d83a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:37.941271 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2ab13a98-42c5-4acf-8164-42d128e0d83a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:38.098810 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2ab13a98-42c5-4acf-8164-42d128e0d83a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:38.108674 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2ab13a98-42c5-4acf-8164-42d128e0d83a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:38.110245 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2ab13a98-42c5-4acf-8164-42d128e0d83a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:38.111394 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2ab13a98-42c5-4acf-8164-42d128e0d83a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.191391 Dec 15 14:09:38.111959 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 403/812] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:37 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:39.134273 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-816a7b13-066a-40ed-a4f6-b8e575304e61 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:39.135233 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-816a7b13-066a-40ed-a4f6-b8e575304e61 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:39.146121 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-816a7b13-066a-40ed-a4f6-b8e575304e61 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:39.146868 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-816a7b13-066a-40ed-a4f6-b8e575304e61 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:39.148011 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-816a7b13-066a-40ed-a4f6-b8e575304e61 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:39.148455 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-816a7b13-066a-40ed-a4f6-b8e575304e61 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:39.287599 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-816a7b13-066a-40ed-a4f6-b8e575304e61 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:39.300741 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-816a7b13-066a-40ed-a4f6-b8e575304e61 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:39.303159 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-816a7b13-066a-40ed-a4f6-b8e575304e61 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:39.304805 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-816a7b13-066a-40ed-a4f6-b8e575304e61 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.176873 Dec 15 14:09:39.305378 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 410/813] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:39 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:40.323980 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-63e148ba-ed04-4dc8-b18a-2686ae14584c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:40.324655 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-63e148ba-ed04-4dc8-b18a-2686ae14584c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:40.331258 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-63e148ba-ed04-4dc8-b18a-2686ae14584c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:40.331710 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-63e148ba-ed04-4dc8-b18a-2686ae14584c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:40.332478 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-63e148ba-ed04-4dc8-b18a-2686ae14584c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:40.332905 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-63e148ba-ed04-4dc8-b18a-2686ae14584c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:40.487541 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-63e148ba-ed04-4dc8-b18a-2686ae14584c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:40.498409 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-63e148ba-ed04-4dc8-b18a-2686ae14584c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:40.499909 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-63e148ba-ed04-4dc8-b18a-2686ae14584c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:40.501077 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-63e148ba-ed04-4dc8-b18a-2686ae14584c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.181446 Dec 15 14:09:40.501665 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 404/814] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:40 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:41.524130 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7a6df1aa-2226-46f1-aa0c-e2a5a6fb6cef tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:41.524735 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7a6df1aa-2226-46f1-aa0c-e2a5a6fb6cef tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:41.531970 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a6df1aa-2226-46f1-aa0c-e2a5a6fb6cef tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:41.532421 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a6df1aa-2226-46f1-aa0c-e2a5a6fb6cef tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:41.533206 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a6df1aa-2226-46f1-aa0c-e2a5a6fb6cef tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:41.533711 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a6df1aa-2226-46f1-aa0c-e2a5a6fb6cef tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:41.674290 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7a6df1aa-2226-46f1-aa0c-e2a5a6fb6cef tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:41.684520 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7a6df1aa-2226-46f1-aa0c-e2a5a6fb6cef tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:41.686304 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7a6df1aa-2226-46f1-aa0c-e2a5a6fb6cef tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:41.687502 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7a6df1aa-2226-46f1-aa0c-e2a5a6fb6cef tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.169091 Dec 15 14:09:41.688116 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 411/815] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:41 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:42.710367 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cc53e8e2-bad7-457e-8fbd-7023ee66d91d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:42.711459 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cc53e8e2-bad7-457e-8fbd-7023ee66d91d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:42.718184 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cc53e8e2-bad7-457e-8fbd-7023ee66d91d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:42.718636 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cc53e8e2-bad7-457e-8fbd-7023ee66d91d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:42.719421 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cc53e8e2-bad7-457e-8fbd-7023ee66d91d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:42.719862 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cc53e8e2-bad7-457e-8fbd-7023ee66d91d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:42.859393 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cc53e8e2-bad7-457e-8fbd-7023ee66d91d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:42.870170 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cc53e8e2-bad7-457e-8fbd-7023ee66d91d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:42.871787 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cc53e8e2-bad7-457e-8fbd-7023ee66d91d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:42.872866 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cc53e8e2-bad7-457e-8fbd-7023ee66d91d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.168849 Dec 15 14:09:42.873443 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 405/816] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:42 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:43.892267 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6ccebcf9-0bbb-47e1-8b1a-771f99297408 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:43.892898 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6ccebcf9-0bbb-47e1-8b1a-771f99297408 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:43.900037 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6ccebcf9-0bbb-47e1-8b1a-771f99297408 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:43.900475 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6ccebcf9-0bbb-47e1-8b1a-771f99297408 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:43.901253 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6ccebcf9-0bbb-47e1-8b1a-771f99297408 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:43.901704 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6ccebcf9-0bbb-47e1-8b1a-771f99297408 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:44.041592 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6ccebcf9-0bbb-47e1-8b1a-771f99297408 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:44.050232 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6ccebcf9-0bbb-47e1-8b1a-771f99297408 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:44.051684 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6ccebcf9-0bbb-47e1-8b1a-771f99297408 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:44.052840 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6ccebcf9-0bbb-47e1-8b1a-771f99297408 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.164553 Dec 15 14:09:44.053401 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 412/817] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:43 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:45.072326 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c3461889-1e29-4413-b90b-8ca5a9e871ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:45.073027 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c3461889-1e29-4413-b90b-8ca5a9e871ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:45.080146 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3461889-1e29-4413-b90b-8ca5a9e871ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:45.080667 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3461889-1e29-4413-b90b-8ca5a9e871ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:45.081862 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3461889-1e29-4413-b90b-8ca5a9e871ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:45.082434 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3461889-1e29-4413-b90b-8ca5a9e871ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:45.236773 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c3461889-1e29-4413-b90b-8ca5a9e871ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:45.245841 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c3461889-1e29-4413-b90b-8ca5a9e871ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:45.247334 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c3461889-1e29-4413-b90b-8ca5a9e871ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:45.248530 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c3461889-1e29-4413-b90b-8ca5a9e871ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.180743 Dec 15 14:09:45.249095 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 406/818] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:45 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:46.271203 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a22e99b3-da64-44d0-a76e-a3107695c504 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:46.272169 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a22e99b3-da64-44d0-a76e-a3107695c504 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:46.281401 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a22e99b3-da64-44d0-a76e-a3107695c504 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:46.281878 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a22e99b3-da64-44d0-a76e-a3107695c504 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:46.282756 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a22e99b3-da64-44d0-a76e-a3107695c504 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:46.283172 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a22e99b3-da64-44d0-a76e-a3107695c504 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:46.428349 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a22e99b3-da64-44d0-a76e-a3107695c504 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:46.439313 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a22e99b3-da64-44d0-a76e-a3107695c504 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:46.441884 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a22e99b3-da64-44d0-a76e-a3107695c504 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:46.443778 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a22e99b3-da64-44d0-a76e-a3107695c504 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.178527 Dec 15 14:09:46.444671 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 413/819] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:46 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:47.468959 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-861c8faf-ae4c-45f1-9c83-d3f28434a463 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:47.469554 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-861c8faf-ae4c-45f1-9c83-d3f28434a463 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:47.477356 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-861c8faf-ae4c-45f1-9c83-d3f28434a463 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:47.477848 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-861c8faf-ae4c-45f1-9c83-d3f28434a463 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:47.478638 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-861c8faf-ae4c-45f1-9c83-d3f28434a463 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:47.479075 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-861c8faf-ae4c-45f1-9c83-d3f28434a463 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:47.624205 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-861c8faf-ae4c-45f1-9c83-d3f28434a463 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:47.632638 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-861c8faf-ae4c-45f1-9c83-d3f28434a463 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:47.634162 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-861c8faf-ae4c-45f1-9c83-d3f28434a463 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:47.635338 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-861c8faf-ae4c-45f1-9c83-d3f28434a463 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.172091 Dec 15 14:09:47.635912 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 407/820] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:47 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:48.657119 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b34feb0c-24e8-415e-ae45-b5a70acb8bcf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:48.658258 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b34feb0c-24e8-415e-ae45-b5a70acb8bcf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:48.667823 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b34feb0c-24e8-415e-ae45-b5a70acb8bcf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:48.668470 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b34feb0c-24e8-415e-ae45-b5a70acb8bcf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:48.669917 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b34feb0c-24e8-415e-ae45-b5a70acb8bcf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:48.670324 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b34feb0c-24e8-415e-ae45-b5a70acb8bcf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:48.811780 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b34feb0c-24e8-415e-ae45-b5a70acb8bcf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:48.823903 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b34feb0c-24e8-415e-ae45-b5a70acb8bcf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:48.826280 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b34feb0c-24e8-415e-ae45-b5a70acb8bcf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:48.826969 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b34feb0c-24e8-415e-ae45-b5a70acb8bcf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.175246 Dec 15 14:09:48.827549 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 414/821] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:48 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:49.848226 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-21e12967-3c9b-42ff-b768-01515eb3c451 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:49.849229 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-21e12967-3c9b-42ff-b768-01515eb3c451 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:49.856600 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21e12967-3c9b-42ff-b768-01515eb3c451 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:49.857098 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21e12967-3c9b-42ff-b768-01515eb3c451 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:49.858051 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21e12967-3c9b-42ff-b768-01515eb3c451 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:49.858662 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21e12967-3c9b-42ff-b768-01515eb3c451 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:50.016813 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-21e12967-3c9b-42ff-b768-01515eb3c451 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:50.025675 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-21e12967-3c9b-42ff-b768-01515eb3c451 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:50.027158 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-21e12967-3c9b-42ff-b768-01515eb3c451 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:50.028289 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-21e12967-3c9b-42ff-b768-01515eb3c451 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.184524 Dec 15 14:09:50.028852 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 408/822] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:49 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:51.047967 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-56fd7b6e-65bd-4dd6-995e-c583096b8dd2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:51.048533 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-56fd7b6e-65bd-4dd6-995e-c583096b8dd2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:51.055630 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56fd7b6e-65bd-4dd6-995e-c583096b8dd2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:51.056076 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56fd7b6e-65bd-4dd6-995e-c583096b8dd2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:51.056849 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56fd7b6e-65bd-4dd6-995e-c583096b8dd2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:51.057278 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56fd7b6e-65bd-4dd6-995e-c583096b8dd2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:51.195746 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-56fd7b6e-65bd-4dd6-995e-c583096b8dd2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:51.204289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-56fd7b6e-65bd-4dd6-995e-c583096b8dd2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:51.205818 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-56fd7b6e-65bd-4dd6-995e-c583096b8dd2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:51.206975 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-56fd7b6e-65bd-4dd6-995e-c583096b8dd2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.163403 Dec 15 14:09:51.207553 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 415/823] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:51 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:52.230552 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e3de6516-6fab-47db-8d6b-3ac03b77d0a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:52.231603 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e3de6516-6fab-47db-8d6b-3ac03b77d0a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:52.242725 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e3de6516-6fab-47db-8d6b-3ac03b77d0a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:52.243465 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e3de6516-6fab-47db-8d6b-3ac03b77d0a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:52.244731 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e3de6516-6fab-47db-8d6b-3ac03b77d0a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:52.245444 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e3de6516-6fab-47db-8d6b-3ac03b77d0a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:52.385344 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e3de6516-6fab-47db-8d6b-3ac03b77d0a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:52.394172 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e3de6516-6fab-47db-8d6b-3ac03b77d0a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:52.395643 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e3de6516-6fab-47db-8d6b-3ac03b77d0a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:52.396793 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e3de6516-6fab-47db-8d6b-3ac03b77d0a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.172975 Dec 15 14:09:52.397444 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 409/824] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:52 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:53.420170 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-63c83aa5-1ee8-4257-b788-88dec43826c1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:53.421114 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-63c83aa5-1ee8-4257-b788-88dec43826c1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:53.434055 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63c83aa5-1ee8-4257-b788-88dec43826c1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:53.434055 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63c83aa5-1ee8-4257-b788-88dec43826c1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:53.434712 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63c83aa5-1ee8-4257-b788-88dec43826c1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:53.435369 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63c83aa5-1ee8-4257-b788-88dec43826c1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:53.585629 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-63c83aa5-1ee8-4257-b788-88dec43826c1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:53.594216 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-63c83aa5-1ee8-4257-b788-88dec43826c1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:53.595729 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-63c83aa5-1ee8-4257-b788-88dec43826c1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:53.596904 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-63c83aa5-1ee8-4257-b788-88dec43826c1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.183414 Dec 15 14:09:53.597470 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 416/825] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:53 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:54.615897 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2aa68f59-8a5d-431b-b550-9a45cb3bff10 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:54.616514 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2aa68f59-8a5d-431b-b550-9a45cb3bff10 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:54.623423 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2aa68f59-8a5d-431b-b550-9a45cb3bff10 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:54.623877 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2aa68f59-8a5d-431b-b550-9a45cb3bff10 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:54.624658 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2aa68f59-8a5d-431b-b550-9a45cb3bff10 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:54.625124 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2aa68f59-8a5d-431b-b550-9a45cb3bff10 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:54.774312 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2aa68f59-8a5d-431b-b550-9a45cb3bff10 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:54.783330 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2aa68f59-8a5d-431b-b550-9a45cb3bff10 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:54.784808 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2aa68f59-8a5d-431b-b550-9a45cb3bff10 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:54.786024 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2aa68f59-8a5d-431b-b550-9a45cb3bff10 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.174000 Dec 15 14:09:54.786586 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 410/826] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:54 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:55.805522 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-61a016aa-4433-41b9-9fd2-a1e193f162d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:55.806258 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-61a016aa-4433-41b9-9fd2-a1e193f162d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:55.814166 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61a016aa-4433-41b9-9fd2-a1e193f162d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:55.814655 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61a016aa-4433-41b9-9fd2-a1e193f162d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:55.815431 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61a016aa-4433-41b9-9fd2-a1e193f162d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:55.816653 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61a016aa-4433-41b9-9fd2-a1e193f162d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:55.962601 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-61a016aa-4433-41b9-9fd2-a1e193f162d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:55.971396 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-61a016aa-4433-41b9-9fd2-a1e193f162d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:55.972898 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-61a016aa-4433-41b9-9fd2-a1e193f162d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:55.974439 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-61a016aa-4433-41b9-9fd2-a1e193f162d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.172821 Dec 15 14:09:55.975019 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 417/827] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:55 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:56.996252 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e7b107a0-66c5-4f46-ad04-3f5ab5ca5f31 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:56.996812 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e7b107a0-66c5-4f46-ad04-3f5ab5ca5f31 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:57.003992 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e7b107a0-66c5-4f46-ad04-3f5ab5ca5f31 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:57.004456 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e7b107a0-66c5-4f46-ad04-3f5ab5ca5f31 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:57.005229 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e7b107a0-66c5-4f46-ad04-3f5ab5ca5f31 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:57.005687 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e7b107a0-66c5-4f46-ad04-3f5ab5ca5f31 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:57.149024 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e7b107a0-66c5-4f46-ad04-3f5ab5ca5f31 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:57.157443 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e7b107a0-66c5-4f46-ad04-3f5ab5ca5f31 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:57.158980 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e7b107a0-66c5-4f46-ad04-3f5ab5ca5f31 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:57.160132 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e7b107a0-66c5-4f46-ad04-3f5ab5ca5f31 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.169168 Dec 15 14:09:57.160701 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 411/828] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:56 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:58.178702 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-423bc4c1-dedb-496d-bc19-50721bd6fb60 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:58.179299 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-423bc4c1-dedb-496d-bc19-50721bd6fb60 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:58.186925 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-423bc4c1-dedb-496d-bc19-50721bd6fb60 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:58.187377 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-423bc4c1-dedb-496d-bc19-50721bd6fb60 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:58.188345 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-423bc4c1-dedb-496d-bc19-50721bd6fb60 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:58.188833 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-423bc4c1-dedb-496d-bc19-50721bd6fb60 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:58.364945 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-423bc4c1-dedb-496d-bc19-50721bd6fb60 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:58.375556 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-423bc4c1-dedb-496d-bc19-50721bd6fb60 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:58.377864 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-423bc4c1-dedb-496d-bc19-50721bd6fb60 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:58.379038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-423bc4c1-dedb-496d-bc19-50721bd6fb60 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.204090 Dec 15 14:09:58.379628 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 418/829] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:58 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:09:59.404956 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-138f2008-10f7-4357-a39f-235f9237deec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:59.405944 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-138f2008-10f7-4357-a39f-235f9237deec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:09:59.413309 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-138f2008-10f7-4357-a39f-235f9237deec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:59.413764 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-138f2008-10f7-4357-a39f-235f9237deec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:59.414588 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-138f2008-10f7-4357-a39f-235f9237deec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:09:59.415018 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-138f2008-10f7-4357-a39f-235f9237deec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:09:59.767179 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-138f2008-10f7-4357-a39f-235f9237deec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:59.776429 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-138f2008-10f7-4357-a39f-235f9237deec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:59.777939 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-138f2008-10f7-4357-a39f-235f9237deec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:09:59.779132 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-138f2008-10f7-4357-a39f-235f9237deec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.380447 Dec 15 14:09:59.779691 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 412/830] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:09:59 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:00.799692 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1542da1d-872f-4f5d-bbdf-0cbb45cc6579 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:00.800333 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1542da1d-872f-4f5d-bbdf-0cbb45cc6579 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:00.807212 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1542da1d-872f-4f5d-bbdf-0cbb45cc6579 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:00.807686 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1542da1d-872f-4f5d-bbdf-0cbb45cc6579 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:00.808472 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1542da1d-872f-4f5d-bbdf-0cbb45cc6579 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:00.808910 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1542da1d-872f-4f5d-bbdf-0cbb45cc6579 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:00.948983 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1542da1d-872f-4f5d-bbdf-0cbb45cc6579 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:00.957793 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1542da1d-872f-4f5d-bbdf-0cbb45cc6579 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:00.959296 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1542da1d-872f-4f5d-bbdf-0cbb45cc6579 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:00.960465 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1542da1d-872f-4f5d-bbdf-0cbb45cc6579 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.165362 Dec 15 14:10:00.961013 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 419/831] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:00 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:01.979477 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2b74c052-05d2-41d5-95a1-bcba70bc9b94 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:01.980098 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2b74c052-05d2-41d5-95a1-bcba70bc9b94 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:01.986835 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b74c052-05d2-41d5-95a1-bcba70bc9b94 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:01.987281 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b74c052-05d2-41d5-95a1-bcba70bc9b94 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:01.988078 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b74c052-05d2-41d5-95a1-bcba70bc9b94 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:01.988736 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b74c052-05d2-41d5-95a1-bcba70bc9b94 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:02.128566 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2b74c052-05d2-41d5-95a1-bcba70bc9b94 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:02.137820 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2b74c052-05d2-41d5-95a1-bcba70bc9b94 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:02.139332 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2b74c052-05d2-41d5-95a1-bcba70bc9b94 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:02.140521 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2b74c052-05d2-41d5-95a1-bcba70bc9b94 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.164777 Dec 15 14:10:02.141073 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 413/832] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:01 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:03.161070 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-083311a5-b70b-4b2d-aaeb-4ff16eb522d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:03.161823 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-083311a5-b70b-4b2d-aaeb-4ff16eb522d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:03.169962 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-083311a5-b70b-4b2d-aaeb-4ff16eb522d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:03.170493 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-083311a5-b70b-4b2d-aaeb-4ff16eb522d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:03.171417 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-083311a5-b70b-4b2d-aaeb-4ff16eb522d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:03.171931 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-083311a5-b70b-4b2d-aaeb-4ff16eb522d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:03.322575 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-083311a5-b70b-4b2d-aaeb-4ff16eb522d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:03.331345 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-083311a5-b70b-4b2d-aaeb-4ff16eb522d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:03.332841 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-083311a5-b70b-4b2d-aaeb-4ff16eb522d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:03.334041 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-083311a5-b70b-4b2d-aaeb-4ff16eb522d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.177765 Dec 15 14:10:03.334612 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 420/833] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:03 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:04.360522 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-be92cacf-ddaa-42b3-bfbd-a78bbbcc931a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:04.361925 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-be92cacf-ddaa-42b3-bfbd-a78bbbcc931a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:04.368944 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-be92cacf-ddaa-42b3-bfbd-a78bbbcc931a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:04.369402 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-be92cacf-ddaa-42b3-bfbd-a78bbbcc931a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:04.370228 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-be92cacf-ddaa-42b3-bfbd-a78bbbcc931a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:04.370666 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-be92cacf-ddaa-42b3-bfbd-a78bbbcc931a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:04.522264 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-be92cacf-ddaa-42b3-bfbd-a78bbbcc931a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:04.530941 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-be92cacf-ddaa-42b3-bfbd-a78bbbcc931a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:04.532471 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-be92cacf-ddaa-42b3-bfbd-a78bbbcc931a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:04.533637 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-be92cacf-ddaa-42b3-bfbd-a78bbbcc931a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.179465 Dec 15 14:10:04.534246 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 414/834] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:04 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:05.552000 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-227c5b9c-d72e-4900-b1c9-d994c3500cc2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:05.552733 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-227c5b9c-d72e-4900-b1c9-d994c3500cc2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:05.559335 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-227c5b9c-d72e-4900-b1c9-d994c3500cc2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:05.559804 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-227c5b9c-d72e-4900-b1c9-d994c3500cc2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:05.560625 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-227c5b9c-d72e-4900-b1c9-d994c3500cc2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:05.561062 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-227c5b9c-d72e-4900-b1c9-d994c3500cc2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:05.870113 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-227c5b9c-d72e-4900-b1c9-d994c3500cc2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:05.879035 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-227c5b9c-d72e-4900-b1c9-d994c3500cc2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:05.880564 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-227c5b9c-d72e-4900-b1c9-d994c3500cc2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:05.881765 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-227c5b9c-d72e-4900-b1c9-d994c3500cc2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.333837 Dec 15 14:10:05.882380 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 421/835] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:05 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:06.908097 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-172aeebd-9b67-410b-89c7-a5fd00004257 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:06.909077 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-172aeebd-9b67-410b-89c7-a5fd00004257 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:06.916878 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-172aeebd-9b67-410b-89c7-a5fd00004257 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:06.917326 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-172aeebd-9b67-410b-89c7-a5fd00004257 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:06.918126 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-172aeebd-9b67-410b-89c7-a5fd00004257 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:06.918554 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-172aeebd-9b67-410b-89c7-a5fd00004257 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:07.056785 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-172aeebd-9b67-410b-89c7-a5fd00004257 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:07.065684 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-172aeebd-9b67-410b-89c7-a5fd00004257 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:07.067182 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-172aeebd-9b67-410b-89c7-a5fd00004257 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:07.068390 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-172aeebd-9b67-410b-89c7-a5fd00004257 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.166721 Dec 15 14:10:07.068945 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 415/836] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:06 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:08.093458 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c119f339-39d9-4839-9241-a61e42a8b964 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:08.094122 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c119f339-39d9-4839-9241-a61e42a8b964 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:08.101589 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c119f339-39d9-4839-9241-a61e42a8b964 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:08.102386 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c119f339-39d9-4839-9241-a61e42a8b964 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:08.103181 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c119f339-39d9-4839-9241-a61e42a8b964 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:08.103616 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c119f339-39d9-4839-9241-a61e42a8b964 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:08.255234 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c119f339-39d9-4839-9241-a61e42a8b964 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:08.264570 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c119f339-39d9-4839-9241-a61e42a8b964 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:08.266090 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c119f339-39d9-4839-9241-a61e42a8b964 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:08.267267 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c119f339-39d9-4839-9241-a61e42a8b964 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.177911 Dec 15 14:10:08.267985 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 422/837] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:08 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:08.990817 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:10:08.991571 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:10:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:10:09.290557 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d09e92b8-299f-488b-9409-0a2f82ba60be tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:09.291082 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d09e92b8-299f-488b-9409-0a2f82ba60be tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:09.297981 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d09e92b8-299f-488b-9409-0a2f82ba60be tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:09.298412 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d09e92b8-299f-488b-9409-0a2f82ba60be tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:09.299196 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d09e92b8-299f-488b-9409-0a2f82ba60be tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:09.299630 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d09e92b8-299f-488b-9409-0a2f82ba60be tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:09.407586 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:10:09.408081 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:10:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:10:09.445590 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d09e92b8-299f-488b-9409-0a2f82ba60be tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:09.457681 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d09e92b8-299f-488b-9409-0a2f82ba60be tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:09.459709 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d09e92b8-299f-488b-9409-0a2f82ba60be tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:09.460878 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d09e92b8-299f-488b-9409-0a2f82ba60be tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.174740 Dec 15 14:10:09.461444 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 416/838] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:09 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:10.480060 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-705b0592-ca46-45be-8f81-4074ae18f42c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:10.480637 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-705b0592-ca46-45be-8f81-4074ae18f42c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:10.487426 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-705b0592-ca46-45be-8f81-4074ae18f42c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:10.487872 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-705b0592-ca46-45be-8f81-4074ae18f42c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:10.488645 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-705b0592-ca46-45be-8f81-4074ae18f42c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:10.489079 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-705b0592-ca46-45be-8f81-4074ae18f42c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:10.641003 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-705b0592-ca46-45be-8f81-4074ae18f42c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:10.650181 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-705b0592-ca46-45be-8f81-4074ae18f42c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:10.651665 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-705b0592-ca46-45be-8f81-4074ae18f42c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:10.652849 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-705b0592-ca46-45be-8f81-4074ae18f42c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.176510 Dec 15 14:10:10.653397 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 423/839] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:10 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:11.678272 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-75cf42ad-ca9e-4303-8594-3e6c6594ed55 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:11.678837 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-75cf42ad-ca9e-4303-8594-3e6c6594ed55 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:11.685891 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75cf42ad-ca9e-4303-8594-3e6c6594ed55 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:11.686362 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75cf42ad-ca9e-4303-8594-3e6c6594ed55 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:11.687158 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75cf42ad-ca9e-4303-8594-3e6c6594ed55 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:11.687594 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75cf42ad-ca9e-4303-8594-3e6c6594ed55 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:11.828530 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-75cf42ad-ca9e-4303-8594-3e6c6594ed55 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:11.837404 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-75cf42ad-ca9e-4303-8594-3e6c6594ed55 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:11.838965 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-75cf42ad-ca9e-4303-8594-3e6c6594ed55 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:11.840127 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-75cf42ad-ca9e-4303-8594-3e6c6594ed55 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.168085 Dec 15 14:10:11.840692 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 417/840] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:11 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:12.858725 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-66360819-5513-44a8-951b-882d8738f6a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:12.859331 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-66360819-5513-44a8-951b-882d8738f6a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:12.866625 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66360819-5513-44a8-951b-882d8738f6a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:12.867076 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66360819-5513-44a8-951b-882d8738f6a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:12.867869 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66360819-5513-44a8-951b-882d8738f6a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:12.868300 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66360819-5513-44a8-951b-882d8738f6a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:13.015188 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-66360819-5513-44a8-951b-882d8738f6a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:13.023584 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-66360819-5513-44a8-951b-882d8738f6a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:13.025053 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-66360819-5513-44a8-951b-882d8738f6a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:13.026242 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-66360819-5513-44a8-951b-882d8738f6a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.171388 Dec 15 14:10:13.026791 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 424/841] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:12 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:14.045410 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c3b84ebb-59e6-49a7-a1b3-3541a99b9357 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:14.046103 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c3b84ebb-59e6-49a7-a1b3-3541a99b9357 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:14.053293 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3b84ebb-59e6-49a7-a1b3-3541a99b9357 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:14.053774 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3b84ebb-59e6-49a7-a1b3-3541a99b9357 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:14.054565 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3b84ebb-59e6-49a7-a1b3-3541a99b9357 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:14.054991 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3b84ebb-59e6-49a7-a1b3-3541a99b9357 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:14.192980 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c3b84ebb-59e6-49a7-a1b3-3541a99b9357 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:14.202220 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c3b84ebb-59e6-49a7-a1b3-3541a99b9357 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:14.203739 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c3b84ebb-59e6-49a7-a1b3-3541a99b9357 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:14.204931 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c3b84ebb-59e6-49a7-a1b3-3541a99b9357 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.163407 Dec 15 14:10:14.205496 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 418/842] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:14 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:15.228008 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e1b1c9cd-1c98-40a4-b34e-65271182fb4c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:15.228907 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e1b1c9cd-1c98-40a4-b34e-65271182fb4c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:15.237706 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1b1c9cd-1c98-40a4-b34e-65271182fb4c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:15.238334 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1b1c9cd-1c98-40a4-b34e-65271182fb4c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:15.239390 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1b1c9cd-1c98-40a4-b34e-65271182fb4c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:15.239977 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1b1c9cd-1c98-40a4-b34e-65271182fb4c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:15.394698 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e1b1c9cd-1c98-40a4-b34e-65271182fb4c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:15.404049 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e1b1c9cd-1c98-40a4-b34e-65271182fb4c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:15.405528 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e1b1c9cd-1c98-40a4-b34e-65271182fb4c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:15.406743 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e1b1c9cd-1c98-40a4-b34e-65271182fb4c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.185256 Dec 15 14:10:15.407289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 425/843] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:15 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:16.430455 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7446063b-1aee-423a-9103-2142c40d2f2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:16.431100 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7446063b-1aee-423a-9103-2142c40d2f2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:16.438565 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7446063b-1aee-423a-9103-2142c40d2f2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:16.439062 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7446063b-1aee-423a-9103-2142c40d2f2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:16.439928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7446063b-1aee-423a-9103-2142c40d2f2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:16.440418 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7446063b-1aee-423a-9103-2142c40d2f2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:16.596953 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7446063b-1aee-423a-9103-2142c40d2f2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:16.606517 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7446063b-1aee-423a-9103-2142c40d2f2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:16.608012 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7446063b-1aee-423a-9103-2142c40d2f2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:16.609189 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7446063b-1aee-423a-9103-2142c40d2f2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.185916 Dec 15 14:10:16.609990 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 419/844] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:16 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:17.633215 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-32eae61a-6b02-493d-bca2-59560a7b3b57 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:17.634226 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-32eae61a-6b02-493d-bca2-59560a7b3b57 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:17.645087 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-32eae61a-6b02-493d-bca2-59560a7b3b57 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:17.645885 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-32eae61a-6b02-493d-bca2-59560a7b3b57 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:17.647705 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-32eae61a-6b02-493d-bca2-59560a7b3b57 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:17.648181 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-32eae61a-6b02-493d-bca2-59560a7b3b57 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:17.797686 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-32eae61a-6b02-493d-bca2-59560a7b3b57 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:17.806942 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-32eae61a-6b02-493d-bca2-59560a7b3b57 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:17.808502 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-32eae61a-6b02-493d-bca2-59560a7b3b57 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:17.809565 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-32eae61a-6b02-493d-bca2-59560a7b3b57 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.183862 Dec 15 14:10:17.810156 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 426/845] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:17 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:18.828540 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-68809f3b-ee04-42b2-97b1-cda747fa2676 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:18.829107 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-68809f3b-ee04-42b2-97b1-cda747fa2676 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:18.835376 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68809f3b-ee04-42b2-97b1-cda747fa2676 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:18.835868 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68809f3b-ee04-42b2-97b1-cda747fa2676 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:18.836730 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68809f3b-ee04-42b2-97b1-cda747fa2676 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:18.837051 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68809f3b-ee04-42b2-97b1-cda747fa2676 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:18.987859 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-68809f3b-ee04-42b2-97b1-cda747fa2676 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:19.000353 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-68809f3b-ee04-42b2-97b1-cda747fa2676 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:19.002646 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-68809f3b-ee04-42b2-97b1-cda747fa2676 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:19.004318 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-68809f3b-ee04-42b2-97b1-cda747fa2676 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.179481 Dec 15 14:10:19.005148 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 420/846] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:18 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:20.026260 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-61c29d12-825b-485e-b2b0-695c0f783725 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:20.026827 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-61c29d12-825b-485e-b2b0-695c0f783725 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:20.034027 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61c29d12-825b-485e-b2b0-695c0f783725 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:20.034409 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61c29d12-825b-485e-b2b0-695c0f783725 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:20.035210 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61c29d12-825b-485e-b2b0-695c0f783725 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:20.035642 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61c29d12-825b-485e-b2b0-695c0f783725 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:20.176446 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-61c29d12-825b-485e-b2b0-695c0f783725 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:20.188186 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-61c29d12-825b-485e-b2b0-695c0f783725 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:20.189784 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-61c29d12-825b-485e-b2b0-695c0f783725 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:20.190948 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-61c29d12-825b-485e-b2b0-695c0f783725 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.169755 Dec 15 14:10:20.191537 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 427/847] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:20 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:21.214460 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-46858191-8ec2-4d19-8292-b6f11619b008 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:21.215071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-46858191-8ec2-4d19-8292-b6f11619b008 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:21.225469 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-46858191-8ec2-4d19-8292-b6f11619b008 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:21.226155 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-46858191-8ec2-4d19-8292-b6f11619b008 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:21.227244 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-46858191-8ec2-4d19-8292-b6f11619b008 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:21.227852 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-46858191-8ec2-4d19-8292-b6f11619b008 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:21.373064 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-46858191-8ec2-4d19-8292-b6f11619b008 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:21.386618 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-46858191-8ec2-4d19-8292-b6f11619b008 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:21.388170 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-46858191-8ec2-4d19-8292-b6f11619b008 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:21.389374 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-46858191-8ec2-4d19-8292-b6f11619b008 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.181178 Dec 15 14:10:21.390068 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 421/848] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:21 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:22.409911 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-64f35710-9f41-4968-b480-44b987a64f36 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:22.410604 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-64f35710-9f41-4968-b480-44b987a64f36 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:22.418164 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-64f35710-9f41-4968-b480-44b987a64f36 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:22.418618 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-64f35710-9f41-4968-b480-44b987a64f36 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:22.419424 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-64f35710-9f41-4968-b480-44b987a64f36 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:22.419866 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-64f35710-9f41-4968-b480-44b987a64f36 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:22.556998 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-64f35710-9f41-4968-b480-44b987a64f36 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:22.566958 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-64f35710-9f41-4968-b480-44b987a64f36 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:22.568849 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-64f35710-9f41-4968-b480-44b987a64f36 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:22.570153 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-64f35710-9f41-4968-b480-44b987a64f36 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.164710 Dec 15 14:10:22.570718 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 428/849] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:22 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:23.589539 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a2fc625f-1b0b-40da-8216-01b2a9212547 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:23.590183 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a2fc625f-1b0b-40da-8216-01b2a9212547 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:23.596866 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2fc625f-1b0b-40da-8216-01b2a9212547 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:23.597333 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2fc625f-1b0b-40da-8216-01b2a9212547 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:23.598527 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2fc625f-1b0b-40da-8216-01b2a9212547 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:23.598956 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2fc625f-1b0b-40da-8216-01b2a9212547 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:23.743480 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a2fc625f-1b0b-40da-8216-01b2a9212547 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:23.752455 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a2fc625f-1b0b-40da-8216-01b2a9212547 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:23.753968 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a2fc625f-1b0b-40da-8216-01b2a9212547 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:23.755127 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a2fc625f-1b0b-40da-8216-01b2a9212547 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.169731 Dec 15 14:10:23.755718 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 422/850] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:23 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:24.780374 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e4112e63-6556-431a-9687-8445c9206c8d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:24.781342 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e4112e63-6556-431a-9687-8445c9206c8d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:24.793210 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4112e63-6556-431a-9687-8445c9206c8d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:24.793594 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4112e63-6556-431a-9687-8445c9206c8d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:24.794426 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4112e63-6556-431a-9687-8445c9206c8d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:24.794867 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4112e63-6556-431a-9687-8445c9206c8d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:24.950488 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e4112e63-6556-431a-9687-8445c9206c8d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:24.960136 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e4112e63-6556-431a-9687-8445c9206c8d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:24.961815 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e4112e63-6556-431a-9687-8445c9206c8d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:24.962984 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e4112e63-6556-431a-9687-8445c9206c8d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.189703 Dec 15 14:10:24.963538 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 429/851] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:24 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:25.985972 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-74f4d0c1-906b-4506-8e10-c2fa08d57380 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:25.986810 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-74f4d0c1-906b-4506-8e10-c2fa08d57380 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:25.997051 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-74f4d0c1-906b-4506-8e10-c2fa08d57380 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:25.997511 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-74f4d0c1-906b-4506-8e10-c2fa08d57380 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:25.998335 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-74f4d0c1-906b-4506-8e10-c2fa08d57380 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:25.998947 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-74f4d0c1-906b-4506-8e10-c2fa08d57380 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:26.148109 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-74f4d0c1-906b-4506-8e10-c2fa08d57380 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:26.157244 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-74f4d0c1-906b-4506-8e10-c2fa08d57380 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:26.158735 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-74f4d0c1-906b-4506-8e10-c2fa08d57380 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:26.160042 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-74f4d0c1-906b-4506-8e10-c2fa08d57380 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.180393 Dec 15 14:10:26.160625 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 423/852] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:25 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:27.182886 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f5b0324f-65fa-4666-abe1-15e703a8f677 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:27.183722 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f5b0324f-65fa-4666-abe1-15e703a8f677 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:27.191111 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5b0324f-65fa-4666-abe1-15e703a8f677 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:27.191561 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5b0324f-65fa-4666-abe1-15e703a8f677 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:27.192349 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5b0324f-65fa-4666-abe1-15e703a8f677 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:27.192793 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5b0324f-65fa-4666-abe1-15e703a8f677 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:27.340287 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f5b0324f-65fa-4666-abe1-15e703a8f677 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:27.350860 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f5b0324f-65fa-4666-abe1-15e703a8f677 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:27.352348 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f5b0324f-65fa-4666-abe1-15e703a8f677 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:27.353600 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f5b0324f-65fa-4666-abe1-15e703a8f677 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.177191 Dec 15 14:10:27.354250 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 430/853] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:27 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:28.372237 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dd07d857-762a-4b66-b0cb-fcfd4ac313a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:28.372841 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dd07d857-762a-4b66-b0cb-fcfd4ac313a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:28.379591 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dd07d857-762a-4b66-b0cb-fcfd4ac313a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:28.380046 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dd07d857-762a-4b66-b0cb-fcfd4ac313a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:28.380835 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dd07d857-762a-4b66-b0cb-fcfd4ac313a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:28.381279 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dd07d857-762a-4b66-b0cb-fcfd4ac313a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:28.529603 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dd07d857-762a-4b66-b0cb-fcfd4ac313a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:28.539168 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dd07d857-762a-4b66-b0cb-fcfd4ac313a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:28.540642 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dd07d857-762a-4b66-b0cb-fcfd4ac313a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:28.541811 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dd07d857-762a-4b66-b0cb-fcfd4ac313a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.173474 Dec 15 14:10:28.542370 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 424/854] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:28 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:29.562292 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dbcdd706-d50e-4b66-8a4a-3896311fbcc7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:29.562849 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dbcdd706-d50e-4b66-8a4a-3896311fbcc7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:29.570023 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dbcdd706-d50e-4b66-8a4a-3896311fbcc7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:29.570468 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dbcdd706-d50e-4b66-8a4a-3896311fbcc7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:29.571227 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dbcdd706-d50e-4b66-8a4a-3896311fbcc7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:29.571645 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dbcdd706-d50e-4b66-8a4a-3896311fbcc7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:29.727001 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dbcdd706-d50e-4b66-8a4a-3896311fbcc7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:29.741308 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dbcdd706-d50e-4b66-8a4a-3896311fbcc7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:29.743840 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dbcdd706-d50e-4b66-8a4a-3896311fbcc7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:29.745789 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dbcdd706-d50e-4b66-8a4a-3896311fbcc7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.187712 Dec 15 14:10:29.746951 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 431/855] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:29 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:30.764730 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-29c038f4-3dde-435a-85c9-fedf6f0453b5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:30.765279 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-29c038f4-3dde-435a-85c9-fedf6f0453b5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:30.771974 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-29c038f4-3dde-435a-85c9-fedf6f0453b5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:30.772414 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-29c038f4-3dde-435a-85c9-fedf6f0453b5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:30.773206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-29c038f4-3dde-435a-85c9-fedf6f0453b5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:30.773659 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-29c038f4-3dde-435a-85c9-fedf6f0453b5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:30.912624 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-29c038f4-3dde-435a-85c9-fedf6f0453b5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:30.921632 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-29c038f4-3dde-435a-85c9-fedf6f0453b5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:30.923123 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-29c038f4-3dde-435a-85c9-fedf6f0453b5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:30.924310 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-29c038f4-3dde-435a-85c9-fedf6f0453b5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.163755 Dec 15 14:10:30.924865 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 425/856] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:30 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:31.942406 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-15865ea7-f2be-412a-8c9d-c651b4fffa47 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:31.943050 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-15865ea7-f2be-412a-8c9d-c651b4fffa47 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:31.950240 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15865ea7-f2be-412a-8c9d-c651b4fffa47 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:31.950872 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15865ea7-f2be-412a-8c9d-c651b4fffa47 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:31.951952 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15865ea7-f2be-412a-8c9d-c651b4fffa47 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:31.952436 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15865ea7-f2be-412a-8c9d-c651b4fffa47 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:32.092335 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-15865ea7-f2be-412a-8c9d-c651b4fffa47 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:32.103798 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-15865ea7-f2be-412a-8c9d-c651b4fffa47 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:32.105300 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-15865ea7-f2be-412a-8c9d-c651b4fffa47 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:32.106556 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-15865ea7-f2be-412a-8c9d-c651b4fffa47 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.168041 Dec 15 14:10:32.107156 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 432/857] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:31 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:33.125957 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-83a9a65f-1274-4710-8c18-2006b9883fa6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:33.126585 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-83a9a65f-1274-4710-8c18-2006b9883fa6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:33.134060 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83a9a65f-1274-4710-8c18-2006b9883fa6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:33.134555 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83a9a65f-1274-4710-8c18-2006b9883fa6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:33.135399 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83a9a65f-1274-4710-8c18-2006b9883fa6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:33.135877 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83a9a65f-1274-4710-8c18-2006b9883fa6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:33.289236 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-83a9a65f-1274-4710-8c18-2006b9883fa6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:33.301060 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-83a9a65f-1274-4710-8c18-2006b9883fa6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:33.303325 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-83a9a65f-1274-4710-8c18-2006b9883fa6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:33.305090 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-83a9a65f-1274-4710-8c18-2006b9883fa6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.183479 Dec 15 14:10:33.305901 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 426/858] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:33 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:34.329275 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-21948342-aa92-4676-8b51-c7d451d79229 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:34.330042 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-21948342-aa92-4676-8b51-c7d451d79229 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:34.338490 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21948342-aa92-4676-8b51-c7d451d79229 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:34.339049 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21948342-aa92-4676-8b51-c7d451d79229 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:34.340019 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21948342-aa92-4676-8b51-c7d451d79229 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:34.340564 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21948342-aa92-4676-8b51-c7d451d79229 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:34.488988 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-21948342-aa92-4676-8b51-c7d451d79229 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:34.502109 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-21948342-aa92-4676-8b51-c7d451d79229 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:34.503086 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-21948342-aa92-4676-8b51-c7d451d79229 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:34.504899 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-21948342-aa92-4676-8b51-c7d451d79229 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.181786 Dec 15 14:10:34.505594 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 433/859] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:34 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:35.528711 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f0564e3b-cf3e-43e0-ba85-8e4218045d29 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:35.530028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f0564e3b-cf3e-43e0-ba85-8e4218045d29 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:35.536694 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f0564e3b-cf3e-43e0-ba85-8e4218045d29 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:35.537167 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f0564e3b-cf3e-43e0-ba85-8e4218045d29 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:35.537995 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f0564e3b-cf3e-43e0-ba85-8e4218045d29 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:35.538568 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f0564e3b-cf3e-43e0-ba85-8e4218045d29 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:35.696681 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f0564e3b-cf3e-43e0-ba85-8e4218045d29 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:35.706967 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f0564e3b-cf3e-43e0-ba85-8e4218045d29 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:35.708433 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f0564e3b-cf3e-43e0-ba85-8e4218045d29 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:35.709591 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f0564e3b-cf3e-43e0-ba85-8e4218045d29 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.187702 Dec 15 14:10:35.710196 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 427/860] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:35 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:36.731713 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b6231cc0-f5bb-4cfa-ab97-b17c1959c5d6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:36.732981 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b6231cc0-f5bb-4cfa-ab97-b17c1959c5d6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:36.739406 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6231cc0-f5bb-4cfa-ab97-b17c1959c5d6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:36.739797 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6231cc0-f5bb-4cfa-ab97-b17c1959c5d6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:36.740576 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6231cc0-f5bb-4cfa-ab97-b17c1959c5d6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:36.741013 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6231cc0-f5bb-4cfa-ab97-b17c1959c5d6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:36.885391 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b6231cc0-f5bb-4cfa-ab97-b17c1959c5d6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:36.894083 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b6231cc0-f5bb-4cfa-ab97-b17c1959c5d6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:36.895564 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b6231cc0-f5bb-4cfa-ab97-b17c1959c5d6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:36.896797 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b6231cc0-f5bb-4cfa-ab97-b17c1959c5d6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.170440 Dec 15 14:10:36.897362 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 434/861] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:36 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:37.915128 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-819dd353-70c7-4fe8-a1fd-a7147aefafca tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:37.915703 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-819dd353-70c7-4fe8-a1fd-a7147aefafca tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:37.922586 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-819dd353-70c7-4fe8-a1fd-a7147aefafca tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:37.923034 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-819dd353-70c7-4fe8-a1fd-a7147aefafca tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:37.923809 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-819dd353-70c7-4fe8-a1fd-a7147aefafca tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:37.924245 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-819dd353-70c7-4fe8-a1fd-a7147aefafca tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:38.066664 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-819dd353-70c7-4fe8-a1fd-a7147aefafca tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:38.075384 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-819dd353-70c7-4fe8-a1fd-a7147aefafca tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:38.076873 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-819dd353-70c7-4fe8-a1fd-a7147aefafca tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:38.078392 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-819dd353-70c7-4fe8-a1fd-a7147aefafca tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.166912 Dec 15 14:10:38.079183 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 428/862] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:37 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:39.100338 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b2028129-46bb-4cc8-beff-6c96032bf100 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:39.101059 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b2028129-46bb-4cc8-beff-6c96032bf100 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:39.110663 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b2028129-46bb-4cc8-beff-6c96032bf100 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:39.111115 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b2028129-46bb-4cc8-beff-6c96032bf100 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:39.111901 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b2028129-46bb-4cc8-beff-6c96032bf100 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:39.112343 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b2028129-46bb-4cc8-beff-6c96032bf100 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:39.260177 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b2028129-46bb-4cc8-beff-6c96032bf100 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:39.273135 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b2028129-46bb-4cc8-beff-6c96032bf100 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:39.275528 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b2028129-46bb-4cc8-beff-6c96032bf100 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:39.277341 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b2028129-46bb-4cc8-beff-6c96032bf100 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.182321 Dec 15 14:10:39.278235 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 435/863] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:39 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:40.299771 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a7ef15ca-34bf-46ba-b0ee-2508260a8b04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:40.300530 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a7ef15ca-34bf-46ba-b0ee-2508260a8b04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:40.309033 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7ef15ca-34bf-46ba-b0ee-2508260a8b04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:40.309626 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7ef15ca-34bf-46ba-b0ee-2508260a8b04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:40.310586 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7ef15ca-34bf-46ba-b0ee-2508260a8b04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:40.311116 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7ef15ca-34bf-46ba-b0ee-2508260a8b04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:40.495939 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a7ef15ca-34bf-46ba-b0ee-2508260a8b04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:40.506389 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a7ef15ca-34bf-46ba-b0ee-2508260a8b04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:40.508622 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a7ef15ca-34bf-46ba-b0ee-2508260a8b04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:40.510349 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a7ef15ca-34bf-46ba-b0ee-2508260a8b04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.216341 Dec 15 14:10:40.511098 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 429/864] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:40 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:41.528316 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-12fdd094-50e0-497f-9b3e-6d198a290a0b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:41.528954 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-12fdd094-50e0-497f-9b3e-6d198a290a0b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:41.536229 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12fdd094-50e0-497f-9b3e-6d198a290a0b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:41.536685 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12fdd094-50e0-497f-9b3e-6d198a290a0b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:41.537543 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12fdd094-50e0-497f-9b3e-6d198a290a0b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:41.538059 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12fdd094-50e0-497f-9b3e-6d198a290a0b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:41.690711 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-12fdd094-50e0-497f-9b3e-6d198a290a0b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:41.699520 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-12fdd094-50e0-497f-9b3e-6d198a290a0b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:41.700933 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-12fdd094-50e0-497f-9b3e-6d198a290a0b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:41.702107 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-12fdd094-50e0-497f-9b3e-6d198a290a0b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.177597 Dec 15 14:10:41.702656 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 436/865] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:41 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:42.721267 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e870a908-8b58-4f15-aa86-5aa2bf408a44 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:42.721910 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e870a908-8b58-4f15-aa86-5aa2bf408a44 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:42.729038 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e870a908-8b58-4f15-aa86-5aa2bf408a44 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:42.729491 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e870a908-8b58-4f15-aa86-5aa2bf408a44 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:42.730304 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e870a908-8b58-4f15-aa86-5aa2bf408a44 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:42.730743 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e870a908-8b58-4f15-aa86-5aa2bf408a44 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:42.874570 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e870a908-8b58-4f15-aa86-5aa2bf408a44 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:42.884555 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e870a908-8b58-4f15-aa86-5aa2bf408a44 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:42.886063 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e870a908-8b58-4f15-aa86-5aa2bf408a44 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:42.887229 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e870a908-8b58-4f15-aa86-5aa2bf408a44 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.170032 Dec 15 14:10:42.887803 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 430/866] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:42 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:43.909648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b860397b-89a2-4239-a5a0-26f54e0f4132 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:43.910328 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b860397b-89a2-4239-a5a0-26f54e0f4132 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:43.918680 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b860397b-89a2-4239-a5a0-26f54e0f4132 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:43.919161 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b860397b-89a2-4239-a5a0-26f54e0f4132 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:43.920248 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b860397b-89a2-4239-a5a0-26f54e0f4132 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:43.920914 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b860397b-89a2-4239-a5a0-26f54e0f4132 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:44.066016 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b860397b-89a2-4239-a5a0-26f54e0f4132 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:44.079158 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b860397b-89a2-4239-a5a0-26f54e0f4132 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:44.080815 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b860397b-89a2-4239-a5a0-26f54e0f4132 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:44.082057 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b860397b-89a2-4239-a5a0-26f54e0f4132 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.178307 Dec 15 14:10:44.082604 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 437/867] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:43 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:45.106736 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2cc64d15-51a2-4341-af39-3ff2d776cbae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:45.107329 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2cc64d15-51a2-4341-af39-3ff2d776cbae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:45.114350 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cc64d15-51a2-4341-af39-3ff2d776cbae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:45.114767 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cc64d15-51a2-4341-af39-3ff2d776cbae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:45.115659 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cc64d15-51a2-4341-af39-3ff2d776cbae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:45.116006 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cc64d15-51a2-4341-af39-3ff2d776cbae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:45.258770 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2cc64d15-51a2-4341-af39-3ff2d776cbae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:45.267537 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2cc64d15-51a2-4341-af39-3ff2d776cbae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:45.269086 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2cc64d15-51a2-4341-af39-3ff2d776cbae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:45.270502 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2cc64d15-51a2-4341-af39-3ff2d776cbae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.167682 Dec 15 14:10:45.271334 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 431/868] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:45 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:46.288531 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5d20e69b-2e10-483f-a341-59e5c7a8c41d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:46.289158 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5d20e69b-2e10-483f-a341-59e5c7a8c41d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:46.295953 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d20e69b-2e10-483f-a341-59e5c7a8c41d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:46.296401 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d20e69b-2e10-483f-a341-59e5c7a8c41d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:46.297260 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d20e69b-2e10-483f-a341-59e5c7a8c41d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:46.297731 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d20e69b-2e10-483f-a341-59e5c7a8c41d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:46.436074 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5d20e69b-2e10-483f-a341-59e5c7a8c41d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:46.445176 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5d20e69b-2e10-483f-a341-59e5c7a8c41d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:46.446698 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5d20e69b-2e10-483f-a341-59e5c7a8c41d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:46.447879 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5d20e69b-2e10-483f-a341-59e5c7a8c41d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.163096 Dec 15 14:10:46.448443 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 438/869] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:46 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:47.467751 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8ce84533-8ff1-4702-912a-05daff37f785 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:47.468355 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8ce84533-8ff1-4702-912a-05daff37f785 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:47.475852 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ce84533-8ff1-4702-912a-05daff37f785 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:47.476299 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ce84533-8ff1-4702-912a-05daff37f785 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:47.477074 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ce84533-8ff1-4702-912a-05daff37f785 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:47.477502 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ce84533-8ff1-4702-912a-05daff37f785 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:47.626506 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8ce84533-8ff1-4702-912a-05daff37f785 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:47.639176 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8ce84533-8ff1-4702-912a-05daff37f785 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:47.641530 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8ce84533-8ff1-4702-912a-05daff37f785 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:47.642900 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8ce84533-8ff1-4702-912a-05daff37f785 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.179027 Dec 15 14:10:47.643470 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 432/870] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:47 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:48.662657 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-87e83060-66ff-4aff-9b64-05a155486d93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:48.663260 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-87e83060-66ff-4aff-9b64-05a155486d93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:48.669936 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87e83060-66ff-4aff-9b64-05a155486d93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:48.670388 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87e83060-66ff-4aff-9b64-05a155486d93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:48.671158 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87e83060-66ff-4aff-9b64-05a155486d93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:48.671588 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87e83060-66ff-4aff-9b64-05a155486d93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:48.824285 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-87e83060-66ff-4aff-9b64-05a155486d93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:48.833820 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-87e83060-66ff-4aff-9b64-05a155486d93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:48.835334 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-87e83060-66ff-4aff-9b64-05a155486d93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:48.836523 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-87e83060-66ff-4aff-9b64-05a155486d93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.177705 Dec 15 14:10:48.837085 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 439/871] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:48 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:49.859894 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7b5f3a1e-696e-49ea-aa7b-bd4977b34ac1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:49.860818 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7b5f3a1e-696e-49ea-aa7b-bd4977b34ac1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:49.867600 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b5f3a1e-696e-49ea-aa7b-bd4977b34ac1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:49.868049 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b5f3a1e-696e-49ea-aa7b-bd4977b34ac1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:49.868865 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b5f3a1e-696e-49ea-aa7b-bd4977b34ac1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:49.869311 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b5f3a1e-696e-49ea-aa7b-bd4977b34ac1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:50.008463 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7b5f3a1e-696e-49ea-aa7b-bd4977b34ac1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:50.021865 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7b5f3a1e-696e-49ea-aa7b-bd4977b34ac1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:50.023974 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7b5f3a1e-696e-49ea-aa7b-bd4977b34ac1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:50.025674 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7b5f3a1e-696e-49ea-aa7b-bd4977b34ac1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.172149 Dec 15 14:10:50.026503 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 433/872] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:49 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:51.050317 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ebdc3973-7724-4cd8-a3cb-89c7aa347058 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:51.051002 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ebdc3973-7724-4cd8-a3cb-89c7aa347058 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:51.059403 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebdc3973-7724-4cd8-a3cb-89c7aa347058 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:51.059972 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebdc3973-7724-4cd8-a3cb-89c7aa347058 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:51.060961 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebdc3973-7724-4cd8-a3cb-89c7aa347058 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:51.061509 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebdc3973-7724-4cd8-a3cb-89c7aa347058 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:51.212122 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ebdc3973-7724-4cd8-a3cb-89c7aa347058 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:51.220672 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ebdc3973-7724-4cd8-a3cb-89c7aa347058 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:51.222528 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ebdc3973-7724-4cd8-a3cb-89c7aa347058 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:51.223718 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ebdc3973-7724-4cd8-a3cb-89c7aa347058 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.179186 Dec 15 14:10:51.224272 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 440/873] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:51 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:52.246407 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4bc74d1c-0926-4054-9a5d-68c634d9bec7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:52.247376 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4bc74d1c-0926-4054-9a5d-68c634d9bec7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:52.258669 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4bc74d1c-0926-4054-9a5d-68c634d9bec7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:52.259123 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4bc74d1c-0926-4054-9a5d-68c634d9bec7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:52.259917 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4bc74d1c-0926-4054-9a5d-68c634d9bec7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:52.260356 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4bc74d1c-0926-4054-9a5d-68c634d9bec7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:52.407875 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4bc74d1c-0926-4054-9a5d-68c634d9bec7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:52.416785 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4bc74d1c-0926-4054-9a5d-68c634d9bec7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:52.418318 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4bc74d1c-0926-4054-9a5d-68c634d9bec7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:52.419474 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4bc74d1c-0926-4054-9a5d-68c634d9bec7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.179442 Dec 15 14:10:52.420035 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 434/874] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:52 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:53.448257 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c754a9d4-1abb-4446-9a8d-c6ecce8c0ca4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:53.449200 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c754a9d4-1abb-4446-9a8d-c6ecce8c0ca4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:53.458106 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c754a9d4-1abb-4446-9a8d-c6ecce8c0ca4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:53.458584 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c754a9d4-1abb-4446-9a8d-c6ecce8c0ca4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:53.459437 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c754a9d4-1abb-4446-9a8d-c6ecce8c0ca4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:53.459881 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c754a9d4-1abb-4446-9a8d-c6ecce8c0ca4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:53.602780 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c754a9d4-1abb-4446-9a8d-c6ecce8c0ca4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:53.611581 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c754a9d4-1abb-4446-9a8d-c6ecce8c0ca4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:53.613081 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c754a9d4-1abb-4446-9a8d-c6ecce8c0ca4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:53.614291 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c754a9d4-1abb-4446-9a8d-c6ecce8c0ca4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.172355 Dec 15 14:10:53.614892 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 441/875] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:53 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:54.633732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f6fa7cb1-c529-407c-b588-69168e5fa972 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:54.634351 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f6fa7cb1-c529-407c-b588-69168e5fa972 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:54.641117 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f6fa7cb1-c529-407c-b588-69168e5fa972 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:54.641576 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f6fa7cb1-c529-407c-b588-69168e5fa972 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:54.642477 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f6fa7cb1-c529-407c-b588-69168e5fa972 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:54.642901 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f6fa7cb1-c529-407c-b588-69168e5fa972 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:54.794932 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f6fa7cb1-c529-407c-b588-69168e5fa972 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:54.803842 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f6fa7cb1-c529-407c-b588-69168e5fa972 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:54.805331 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f6fa7cb1-c529-407c-b588-69168e5fa972 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:54.806522 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f6fa7cb1-c529-407c-b588-69168e5fa972 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.176817 Dec 15 14:10:54.807087 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 435/876] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:54 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:55.825925 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-19a24be8-cbc2-4552-bd58-4327f7a0b931 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:55.826508 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-19a24be8-cbc2-4552-bd58-4327f7a0b931 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:55.833420 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-19a24be8-cbc2-4552-bd58-4327f7a0b931 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:55.833905 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-19a24be8-cbc2-4552-bd58-4327f7a0b931 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:55.834690 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-19a24be8-cbc2-4552-bd58-4327f7a0b931 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:55.835130 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-19a24be8-cbc2-4552-bd58-4327f7a0b931 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:55.975467 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-19a24be8-cbc2-4552-bd58-4327f7a0b931 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:55.988527 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-19a24be8-cbc2-4552-bd58-4327f7a0b931 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:55.990910 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-19a24be8-cbc2-4552-bd58-4327f7a0b931 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:55.992741 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-19a24be8-cbc2-4552-bd58-4327f7a0b931 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.170498 Dec 15 14:10:55.993551 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 442/877] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:55 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:57.015086 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a8597928-caae-46fb-9430-509e4e6c43c6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:57.016038 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a8597928-caae-46fb-9430-509e4e6c43c6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:57.026767 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a8597928-caae-46fb-9430-509e4e6c43c6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:57.027273 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a8597928-caae-46fb-9430-509e4e6c43c6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:57.028487 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a8597928-caae-46fb-9430-509e4e6c43c6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:57.029172 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a8597928-caae-46fb-9430-509e4e6c43c6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:57.191263 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a8597928-caae-46fb-9430-509e4e6c43c6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:57.204044 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a8597928-caae-46fb-9430-509e4e6c43c6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:57.205879 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a8597928-caae-46fb-9430-509e4e6c43c6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:57.207383 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a8597928-caae-46fb-9430-509e4e6c43c6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.198057 Dec 15 14:10:57.207975 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 436/878] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:57 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:58.230666 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bc1b5309-e008-47cd-a3bd-4aad8f8e276a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:58.231688 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bc1b5309-e008-47cd-a3bd-4aad8f8e276a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:58.242681 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc1b5309-e008-47cd-a3bd-4aad8f8e276a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:58.243426 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc1b5309-e008-47cd-a3bd-4aad8f8e276a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:58.244720 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc1b5309-e008-47cd-a3bd-4aad8f8e276a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:58.245445 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc1b5309-e008-47cd-a3bd-4aad8f8e276a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:58.393026 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bc1b5309-e008-47cd-a3bd-4aad8f8e276a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:58.401961 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bc1b5309-e008-47cd-a3bd-4aad8f8e276a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:58.403446 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bc1b5309-e008-47cd-a3bd-4aad8f8e276a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:58.404622 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bc1b5309-e008-47cd-a3bd-4aad8f8e276a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.180485 Dec 15 14:10:58.405173 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 443/879] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:58 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:10:59.424070 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6d41e4d8-bb8a-4c7a-9dd9-cc815cfee74a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:10:59.424647 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6d41e4d8-bb8a-4c7a-9dd9-cc815cfee74a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:10:59.434030 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d41e4d8-bb8a-4c7a-9dd9-cc815cfee74a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:59.434476 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d41e4d8-bb8a-4c7a-9dd9-cc815cfee74a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:59.435361 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d41e4d8-bb8a-4c7a-9dd9-cc815cfee74a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:10:59.435875 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d41e4d8-bb8a-4c7a-9dd9-cc815cfee74a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:10:59.616056 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6d41e4d8-bb8a-4c7a-9dd9-cc815cfee74a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:59.624977 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6d41e4d8-bb8a-4c7a-9dd9-cc815cfee74a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:59.626544 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6d41e4d8-bb8a-4c7a-9dd9-cc815cfee74a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:10:59.627715 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6d41e4d8-bb8a-4c7a-9dd9-cc815cfee74a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.207922 Dec 15 14:10:59.628254 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 437/880] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:10:59 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:00.646754 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fbc2f721-64f7-49ec-8c08-cf20d7aac66e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:00.647426 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fbc2f721-64f7-49ec-8c08-cf20d7aac66e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:00.654337 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fbc2f721-64f7-49ec-8c08-cf20d7aac66e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:00.654781 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fbc2f721-64f7-49ec-8c08-cf20d7aac66e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:00.655686 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fbc2f721-64f7-49ec-8c08-cf20d7aac66e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:00.656164 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fbc2f721-64f7-49ec-8c08-cf20d7aac66e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:00.803461 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fbc2f721-64f7-49ec-8c08-cf20d7aac66e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:00.812153 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fbc2f721-64f7-49ec-8c08-cf20d7aac66e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:00.813887 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fbc2f721-64f7-49ec-8c08-cf20d7aac66e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:00.815118 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fbc2f721-64f7-49ec-8c08-cf20d7aac66e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.172419 Dec 15 14:11:00.815886 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 444/881] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:00 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:01.836533 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4cb366e2-95ab-4770-8794-6e9761eb2280 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:01.837179 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4cb366e2-95ab-4770-8794-6e9761eb2280 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:01.844794 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4cb366e2-95ab-4770-8794-6e9761eb2280 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:01.845312 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4cb366e2-95ab-4770-8794-6e9761eb2280 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:01.846327 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4cb366e2-95ab-4770-8794-6e9761eb2280 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:01.847186 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4cb366e2-95ab-4770-8794-6e9761eb2280 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:01.996369 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4cb366e2-95ab-4770-8794-6e9761eb2280 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:02.008061 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4cb366e2-95ab-4770-8794-6e9761eb2280 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:02.010205 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4cb366e2-95ab-4770-8794-6e9761eb2280 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:02.012002 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4cb366e2-95ab-4770-8794-6e9761eb2280 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.179736 Dec 15 14:11:02.012847 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 438/882] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:01 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:03.048344 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-214ffea3-df40-4d3a-8885-0835b28cfcb5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:03.049295 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-214ffea3-df40-4d3a-8885-0835b28cfcb5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:03.056771 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-214ffea3-df40-4d3a-8885-0835b28cfcb5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:03.057227 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-214ffea3-df40-4d3a-8885-0835b28cfcb5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:03.058094 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-214ffea3-df40-4d3a-8885-0835b28cfcb5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:03.058567 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-214ffea3-df40-4d3a-8885-0835b28cfcb5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:03.197996 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-214ffea3-df40-4d3a-8885-0835b28cfcb5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:03.209036 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-214ffea3-df40-4d3a-8885-0835b28cfcb5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:03.210582 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-214ffea3-df40-4d3a-8885-0835b28cfcb5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:03.211756 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-214ffea3-df40-4d3a-8885-0835b28cfcb5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.170167 Dec 15 14:11:03.212304 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 445/883] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:03 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:04.230836 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-683c2e96-1d76-4245-a516-818da251adbf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:04.231423 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-683c2e96-1d76-4245-a516-818da251adbf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:04.238142 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-683c2e96-1d76-4245-a516-818da251adbf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:04.238588 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-683c2e96-1d76-4245-a516-818da251adbf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:04.239474 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-683c2e96-1d76-4245-a516-818da251adbf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:04.239814 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-683c2e96-1d76-4245-a516-818da251adbf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:04.380326 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-683c2e96-1d76-4245-a516-818da251adbf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:04.389663 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-683c2e96-1d76-4245-a516-818da251adbf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:04.391225 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-683c2e96-1d76-4245-a516-818da251adbf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:04.392399 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-683c2e96-1d76-4245-a516-818da251adbf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.165354 Dec 15 14:11:04.393235 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 439/884] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:04 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:11:05.413970 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e30ab9a2-a78d-4773-b046-d891347e9e89 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:05.414731 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e30ab9a2-a78d-4773-b046-d891347e9e89 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:05.423459 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e30ab9a2-a78d-4773-b046-d891347e9e89 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:05.424059 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e30ab9a2-a78d-4773-b046-d891347e9e89 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:05.425099 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e30ab9a2-a78d-4773-b046-d891347e9e89 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:05.425688 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e30ab9a2-a78d-4773-b046-d891347e9e89 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:05.575561 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e30ab9a2-a78d-4773-b046-d891347e9e89 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:05.584320 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e30ab9a2-a78d-4773-b046-d891347e9e89 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:05.585950 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e30ab9a2-a78d-4773-b046-d891347e9e89 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:05.587078 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e30ab9a2-a78d-4773-b046-d891347e9e89 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.178096 Dec 15 14:11:05.587621 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 446/885] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:05 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:06.606676 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-25dc6788-3926-4461-afc3-42ed06229689 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:06.607269 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-25dc6788-3926-4461-afc3-42ed06229689 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:06.614093 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-25dc6788-3926-4461-afc3-42ed06229689 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:06.614542 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-25dc6788-3926-4461-afc3-42ed06229689 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:06.615316 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-25dc6788-3926-4461-afc3-42ed06229689 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:06.615744 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-25dc6788-3926-4461-afc3-42ed06229689 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:06.774294 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-25dc6788-3926-4461-afc3-42ed06229689 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:06.782826 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-25dc6788-3926-4461-afc3-42ed06229689 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:06.784338 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-25dc6788-3926-4461-afc3-42ed06229689 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:06.785496 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-25dc6788-3926-4461-afc3-42ed06229689 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.182806 Dec 15 14:11:06.786080 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 440/886] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:06 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:07.804528 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5ccec40d-243d-485c-b9b6-fba01cde71d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:07.805118 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5ccec40d-243d-485c-b9b6-fba01cde71d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:07.812503 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ccec40d-243d-485c-b9b6-fba01cde71d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:07.812962 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ccec40d-243d-485c-b9b6-fba01cde71d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:07.814093 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ccec40d-243d-485c-b9b6-fba01cde71d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:07.814548 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ccec40d-243d-485c-b9b6-fba01cde71d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:07.962995 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5ccec40d-243d-485c-b9b6-fba01cde71d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:07.977576 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5ccec40d-243d-485c-b9b6-fba01cde71d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:07.979531 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5ccec40d-243d-485c-b9b6-fba01cde71d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:07.980778 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5ccec40d-243d-485c-b9b6-fba01cde71d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.180100 Dec 15 14:11:07.981387 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 447/887] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:07 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:09.008327 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9a8c4ae7-d63f-4885-bec1-3159ac7d6b20 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:09.009084 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9a8c4ae7-d63f-4885-bec1-3159ac7d6b20 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:09.018244 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a8c4ae7-d63f-4885-bec1-3159ac7d6b20 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:09.018802 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a8c4ae7-d63f-4885-bec1-3159ac7d6b20 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:09.019771 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a8c4ae7-d63f-4885-bec1-3159ac7d6b20 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:09.020314 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a8c4ae7-d63f-4885-bec1-3159ac7d6b20 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:09.159493 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9a8c4ae7-d63f-4885-bec1-3159ac7d6b20 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:09.172556 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9a8c4ae7-d63f-4885-bec1-3159ac7d6b20 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:09.174883 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9a8c4ae7-d63f-4885-bec1-3159ac7d6b20 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:09.176697 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9a8c4ae7-d63f-4885-bec1-3159ac7d6b20 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.172840 Dec 15 14:11:09.177507 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 441/888] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:09 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:10.199079 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-90fbbef8-38da-4605-ae0b-7c2443ee00e4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:10.199766 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-90fbbef8-38da-4605-ae0b-7c2443ee00e4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:10.207200 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90fbbef8-38da-4605-ae0b-7c2443ee00e4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:10.207706 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90fbbef8-38da-4605-ae0b-7c2443ee00e4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:10.208578 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90fbbef8-38da-4605-ae0b-7c2443ee00e4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:10.209070 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90fbbef8-38da-4605-ae0b-7c2443ee00e4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:10.349992 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90fbbef8-38da-4605-ae0b-7c2443ee00e4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:10.361809 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90fbbef8-38da-4605-ae0b-7c2443ee00e4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:10.364162 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90fbbef8-38da-4605-ae0b-7c2443ee00e4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:10.365965 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-90fbbef8-38da-4605-ae0b-7c2443ee00e4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.172853 Dec 15 14:11:10.366687 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 448/889] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:10 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:11.386994 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5f7fdd67-14de-4950-96d5-0d89c84acd85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:11.387609 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5f7fdd67-14de-4950-96d5-0d89c84acd85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:11.395439 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f7fdd67-14de-4950-96d5-0d89c84acd85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:11.396171 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f7fdd67-14de-4950-96d5-0d89c84acd85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:11.397555 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f7fdd67-14de-4950-96d5-0d89c84acd85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:11.398413 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f7fdd67-14de-4950-96d5-0d89c84acd85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:11.566539 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5f7fdd67-14de-4950-96d5-0d89c84acd85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:11.575550 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5f7fdd67-14de-4950-96d5-0d89c84acd85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:11.577024 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5f7fdd67-14de-4950-96d5-0d89c84acd85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:11.578276 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5f7fdd67-14de-4950-96d5-0d89c84acd85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.195143 Dec 15 14:11:11.581448 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 442/890] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:11 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:12.601140 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2a10f682-e3f7-4174-8080-8bc96bf6d95a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:12.602142 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2a10f682-e3f7-4174-8080-8bc96bf6d95a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:12.613361 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a10f682-e3f7-4174-8080-8bc96bf6d95a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:12.614161 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a10f682-e3f7-4174-8080-8bc96bf6d95a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:12.615480 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a10f682-e3f7-4174-8080-8bc96bf6d95a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:12.616212 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a10f682-e3f7-4174-8080-8bc96bf6d95a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:12.763846 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2a10f682-e3f7-4174-8080-8bc96bf6d95a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:12.772692 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2a10f682-e3f7-4174-8080-8bc96bf6d95a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:12.774276 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2a10f682-e3f7-4174-8080-8bc96bf6d95a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:12.775507 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2a10f682-e3f7-4174-8080-8bc96bf6d95a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.181122 Dec 15 14:11:12.776064 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 449/891] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:12 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:13.795993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fa3e4667-0ed4-4216-9bb4-8ee8db4ea1a7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:13.796616 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fa3e4667-0ed4-4216-9bb4-8ee8db4ea1a7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:13.803696 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa3e4667-0ed4-4216-9bb4-8ee8db4ea1a7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:13.804153 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa3e4667-0ed4-4216-9bb4-8ee8db4ea1a7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:13.804941 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa3e4667-0ed4-4216-9bb4-8ee8db4ea1a7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:13.805384 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa3e4667-0ed4-4216-9bb4-8ee8db4ea1a7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:13.949649 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fa3e4667-0ed4-4216-9bb4-8ee8db4ea1a7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:13.958232 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fa3e4667-0ed4-4216-9bb4-8ee8db4ea1a7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:13.959721 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fa3e4667-0ed4-4216-9bb4-8ee8db4ea1a7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:13.960876 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fa3e4667-0ed4-4216-9bb4-8ee8db4ea1a7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.169492 Dec 15 14:11:13.961446 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 443/892] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:13 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:14.985165 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d76f2857-82ef-47c7-82b5-a2b140c1b6ee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:14.986060 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d76f2857-82ef-47c7-82b5-a2b140c1b6ee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:14.996993 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d76f2857-82ef-47c7-82b5-a2b140c1b6ee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:14.997436 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d76f2857-82ef-47c7-82b5-a2b140c1b6ee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:14.998248 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d76f2857-82ef-47c7-82b5-a2b140c1b6ee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:14.998685 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d76f2857-82ef-47c7-82b5-a2b140c1b6ee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:15.148046 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d76f2857-82ef-47c7-82b5-a2b140c1b6ee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:15.159937 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d76f2857-82ef-47c7-82b5-a2b140c1b6ee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:15.162021 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d76f2857-82ef-47c7-82b5-a2b140c1b6ee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:15.163176 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d76f2857-82ef-47c7-82b5-a2b140c1b6ee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.185023 Dec 15 14:11:15.163749 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 450/893] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:14 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:16.186310 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0016ce0a-c89e-4900-befd-4b8f911f3b7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:16.187341 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0016ce0a-c89e-4900-befd-4b8f911f3b7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:16.198147 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0016ce0a-c89e-4900-befd-4b8f911f3b7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:16.198886 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0016ce0a-c89e-4900-befd-4b8f911f3b7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:16.200154 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0016ce0a-c89e-4900-befd-4b8f911f3b7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:16.200863 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0016ce0a-c89e-4900-befd-4b8f911f3b7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:16.347446 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0016ce0a-c89e-4900-befd-4b8f911f3b7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:16.356537 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0016ce0a-c89e-4900-befd-4b8f911f3b7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:16.358618 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0016ce0a-c89e-4900-befd-4b8f911f3b7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:16.359818 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0016ce0a-c89e-4900-befd-4b8f911f3b7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.180364 Dec 15 14:11:16.360387 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 444/894] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:16 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:17.386065 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9031dde0-0ceb-402a-802e-c60cf19f10cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:17.387133 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9031dde0-0ceb-402a-802e-c60cf19f10cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:17.394914 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9031dde0-0ceb-402a-802e-c60cf19f10cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:17.395361 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9031dde0-0ceb-402a-802e-c60cf19f10cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:17.396151 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9031dde0-0ceb-402a-802e-c60cf19f10cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:17.396584 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9031dde0-0ceb-402a-802e-c60cf19f10cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:17.542883 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9031dde0-0ceb-402a-802e-c60cf19f10cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:17.552085 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9031dde0-0ceb-402a-802e-c60cf19f10cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:17.553589 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9031dde0-0ceb-402a-802e-c60cf19f10cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:17.554790 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9031dde0-0ceb-402a-802e-c60cf19f10cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.177624 Dec 15 14:11:17.555358 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 451/895] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:17 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:18.576045 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-55a5c975-b643-4e49-8107-40017e6fa87a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:18.576970 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-55a5c975-b643-4e49-8107-40017e6fa87a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:18.586069 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55a5c975-b643-4e49-8107-40017e6fa87a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:18.586584 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55a5c975-b643-4e49-8107-40017e6fa87a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:18.587626 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55a5c975-b643-4e49-8107-40017e6fa87a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:18.588217 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55a5c975-b643-4e49-8107-40017e6fa87a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:18.745451 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-55a5c975-b643-4e49-8107-40017e6fa87a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:18.755092 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-55a5c975-b643-4e49-8107-40017e6fa87a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:18.756620 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-55a5c975-b643-4e49-8107-40017e6fa87a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:18.757819 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-55a5c975-b643-4e49-8107-40017e6fa87a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.186743 Dec 15 14:11:18.758397 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 445/896] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:18 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:19.779048 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8e2ea98b-dbf8-4931-907d-c4c3166a2e28 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:19.779759 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8e2ea98b-dbf8-4931-907d-c4c3166a2e28 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:19.787444 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e2ea98b-dbf8-4931-907d-c4c3166a2e28 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:19.788023 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e2ea98b-dbf8-4931-907d-c4c3166a2e28 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:19.788886 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e2ea98b-dbf8-4931-907d-c4c3166a2e28 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:19.789391 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e2ea98b-dbf8-4931-907d-c4c3166a2e28 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:19.937381 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8e2ea98b-dbf8-4931-907d-c4c3166a2e28 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:19.946911 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8e2ea98b-dbf8-4931-907d-c4c3166a2e28 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:19.948416 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8e2ea98b-dbf8-4931-907d-c4c3166a2e28 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:19.949597 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8e2ea98b-dbf8-4931-907d-c4c3166a2e28 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.175029 Dec 15 14:11:19.950178 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 452/897] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:19 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:20.971696 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2cd1d197-7eb5-41a2-8c0e-6d8c49bbecee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:20.972304 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2cd1d197-7eb5-41a2-8c0e-6d8c49bbecee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:20.980120 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cd1d197-7eb5-41a2-8c0e-6d8c49bbecee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:20.980621 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cd1d197-7eb5-41a2-8c0e-6d8c49bbecee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:20.981504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cd1d197-7eb5-41a2-8c0e-6d8c49bbecee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:20.982028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cd1d197-7eb5-41a2-8c0e-6d8c49bbecee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:21.124421 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2cd1d197-7eb5-41a2-8c0e-6d8c49bbecee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:21.133016 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2cd1d197-7eb5-41a2-8c0e-6d8c49bbecee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:21.134537 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2cd1d197-7eb5-41a2-8c0e-6d8c49bbecee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:21.135712 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2cd1d197-7eb5-41a2-8c0e-6d8c49bbecee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.169874 Dec 15 14:11:21.136278 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 446/898] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:20 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:22.155000 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d7e82f6c-0e22-4faf-9aaf-f04b05ffeb63 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:22.155634 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d7e82f6c-0e22-4faf-9aaf-f04b05ffeb63 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:22.162677 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7e82f6c-0e22-4faf-9aaf-f04b05ffeb63 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:22.163105 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7e82f6c-0e22-4faf-9aaf-f04b05ffeb63 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:22.163894 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7e82f6c-0e22-4faf-9aaf-f04b05ffeb63 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:22.164596 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7e82f6c-0e22-4faf-9aaf-f04b05ffeb63 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:22.304174 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d7e82f6c-0e22-4faf-9aaf-f04b05ffeb63 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:22.313414 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d7e82f6c-0e22-4faf-9aaf-f04b05ffeb63 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:22.314946 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d7e82f6c-0e22-4faf-9aaf-f04b05ffeb63 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:22.316121 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d7e82f6c-0e22-4faf-9aaf-f04b05ffeb63 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.165189 Dec 15 14:11:22.316648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 453/899] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:22 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:23.339285 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0ad3f7b7-44b9-4211-a3fd-a5f5306a675f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:23.339876 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0ad3f7b7-44b9-4211-a3fd-a5f5306a675f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:23.347140 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ad3f7b7-44b9-4211-a3fd-a5f5306a675f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:23.347598 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ad3f7b7-44b9-4211-a3fd-a5f5306a675f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:23.348377 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ad3f7b7-44b9-4211-a3fd-a5f5306a675f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:23.348810 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ad3f7b7-44b9-4211-a3fd-a5f5306a675f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:23.495741 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0ad3f7b7-44b9-4211-a3fd-a5f5306a675f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:23.504759 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0ad3f7b7-44b9-4211-a3fd-a5f5306a675f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:23.506285 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0ad3f7b7-44b9-4211-a3fd-a5f5306a675f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:23.507471 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0ad3f7b7-44b9-4211-a3fd-a5f5306a675f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.171945 Dec 15 14:11:23.508021 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 447/900] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:23 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:24.528647 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e1c0ff8a-ebbe-4a6b-acde-8245f88e24f5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:24.529351 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e1c0ff8a-ebbe-4a6b-acde-8245f88e24f5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:24.537346 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1c0ff8a-ebbe-4a6b-acde-8245f88e24f5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:24.537825 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1c0ff8a-ebbe-4a6b-acde-8245f88e24f5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:24.538617 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1c0ff8a-ebbe-4a6b-acde-8245f88e24f5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:24.539055 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1c0ff8a-ebbe-4a6b-acde-8245f88e24f5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:24.687567 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e1c0ff8a-ebbe-4a6b-acde-8245f88e24f5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:24.696316 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e1c0ff8a-ebbe-4a6b-acde-8245f88e24f5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:24.697843 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e1c0ff8a-ebbe-4a6b-acde-8245f88e24f5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:24.699013 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e1c0ff8a-ebbe-4a6b-acde-8245f88e24f5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.175514 Dec 15 14:11:24.699584 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 454/901] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:24 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:25.717435 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-17329e79-d88c-4bb1-92d4-783c6bc9a309 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:25.718068 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-17329e79-d88c-4bb1-92d4-783c6bc9a309 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:25.725230 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17329e79-d88c-4bb1-92d4-783c6bc9a309 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:25.725665 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17329e79-d88c-4bb1-92d4-783c6bc9a309 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:25.726719 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17329e79-d88c-4bb1-92d4-783c6bc9a309 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:25.727127 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17329e79-d88c-4bb1-92d4-783c6bc9a309 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:25.912104 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-17329e79-d88c-4bb1-92d4-783c6bc9a309 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:25.921117 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-17329e79-d88c-4bb1-92d4-783c6bc9a309 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:25.923037 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-17329e79-d88c-4bb1-92d4-783c6bc9a309 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:25.924233 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-17329e79-d88c-4bb1-92d4-783c6bc9a309 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.210678 Dec 15 14:11:25.924773 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 448/902] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:25 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:26.943496 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-decacc49-218d-49ba-9204-c2194aed76fc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:26.943894 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-decacc49-218d-49ba-9204-c2194aed76fc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:26.950184 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-decacc49-218d-49ba-9204-c2194aed76fc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:26.950637 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-decacc49-218d-49ba-9204-c2194aed76fc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:26.951427 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-decacc49-218d-49ba-9204-c2194aed76fc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:26.951924 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-decacc49-218d-49ba-9204-c2194aed76fc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:27.100014 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-decacc49-218d-49ba-9204-c2194aed76fc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:27.113961 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-decacc49-218d-49ba-9204-c2194aed76fc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:27.115800 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-decacc49-218d-49ba-9204-c2194aed76fc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:27.117662 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-decacc49-218d-49ba-9204-c2194aed76fc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.178929 Dec 15 14:11:27.118636 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 455/903] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:26 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:28.138625 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0441efe8-c429-4642-9f3d-560d0aa61770 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:28.139230 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0441efe8-c429-4642-9f3d-560d0aa61770 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:28.147427 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0441efe8-c429-4642-9f3d-560d0aa61770 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:28.147927 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0441efe8-c429-4642-9f3d-560d0aa61770 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:28.148769 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0441efe8-c429-4642-9f3d-560d0aa61770 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:28.149423 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0441efe8-c429-4642-9f3d-560d0aa61770 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:28.293414 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0441efe8-c429-4642-9f3d-560d0aa61770 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:28.302291 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0441efe8-c429-4642-9f3d-560d0aa61770 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:28.303799 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0441efe8-c429-4642-9f3d-560d0aa61770 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:28.304975 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0441efe8-c429-4642-9f3d-560d0aa61770 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.170206 Dec 15 14:11:28.305578 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 449/904] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:28 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:29.325904 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5c895074-e2e5-4374-b8af-0b5327fe5e86 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:29.326669 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5c895074-e2e5-4374-b8af-0b5327fe5e86 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:29.335561 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c895074-e2e5-4374-b8af-0b5327fe5e86 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:29.336122 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c895074-e2e5-4374-b8af-0b5327fe5e86 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:29.337095 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c895074-e2e5-4374-b8af-0b5327fe5e86 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:29.337664 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c895074-e2e5-4374-b8af-0b5327fe5e86 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:29.491184 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5c895074-e2e5-4374-b8af-0b5327fe5e86 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:29.504138 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5c895074-e2e5-4374-b8af-0b5327fe5e86 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:29.505822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5c895074-e2e5-4374-b8af-0b5327fe5e86 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:29.507047 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5c895074-e2e5-4374-b8af-0b5327fe5e86 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.186017 Dec 15 14:11:29.507603 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 456/905] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:29 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:30.526336 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e5025ce6-c9ea-45f6-8b62-4e66496cdfab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:30.527012 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e5025ce6-c9ea-45f6-8b62-4e66496cdfab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:30.534046 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e5025ce6-c9ea-45f6-8b62-4e66496cdfab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:30.534497 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e5025ce6-c9ea-45f6-8b62-4e66496cdfab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:30.535282 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e5025ce6-c9ea-45f6-8b62-4e66496cdfab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:30.535719 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e5025ce6-c9ea-45f6-8b62-4e66496cdfab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:30.685932 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e5025ce6-c9ea-45f6-8b62-4e66496cdfab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:30.698959 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e5025ce6-c9ea-45f6-8b62-4e66496cdfab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:30.701375 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e5025ce6-c9ea-45f6-8b62-4e66496cdfab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:30.703053 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e5025ce6-c9ea-45f6-8b62-4e66496cdfab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.180524 Dec 15 14:11:30.703946 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 450/906] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:30 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:31.722093 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3b268755-2de2-4b80-a926-c3f046fba9d8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:31.722668 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3b268755-2de2-4b80-a926-c3f046fba9d8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:31.729401 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b268755-2de2-4b80-a926-c3f046fba9d8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:31.729877 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b268755-2de2-4b80-a926-c3f046fba9d8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:31.730646 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b268755-2de2-4b80-a926-c3f046fba9d8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:31.731077 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b268755-2de2-4b80-a926-c3f046fba9d8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:31.875814 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3b268755-2de2-4b80-a926-c3f046fba9d8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:31.884997 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3b268755-2de2-4b80-a926-c3f046fba9d8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:31.886519 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3b268755-2de2-4b80-a926-c3f046fba9d8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:31.887672 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3b268755-2de2-4b80-a926-c3f046fba9d8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.169749 Dec 15 14:11:31.888257 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 457/907] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:31 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:32.909519 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0cbf2dbf-2109-406d-9410-23c8166c38c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:32.910572 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0cbf2dbf-2109-406d-9410-23c8166c38c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:32.922369 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0cbf2dbf-2109-406d-9410-23c8166c38c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:32.923134 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0cbf2dbf-2109-406d-9410-23c8166c38c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:32.924431 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0cbf2dbf-2109-406d-9410-23c8166c38c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:32.925148 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0cbf2dbf-2109-406d-9410-23c8166c38c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:33.074570 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0cbf2dbf-2109-406d-9410-23c8166c38c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:33.083150 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0cbf2dbf-2109-406d-9410-23c8166c38c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:33.084631 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0cbf2dbf-2109-406d-9410-23c8166c38c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:33.085923 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0cbf2dbf-2109-406d-9410-23c8166c38c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.182209 Dec 15 14:11:33.086504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 451/908] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:32 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:34.109993 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4ef33dc9-accc-4091-a755-e30f166270ad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:34.110520 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4ef33dc9-accc-4091-a755-e30f166270ad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:34.117476 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ef33dc9-accc-4091-a755-e30f166270ad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:34.117968 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ef33dc9-accc-4091-a755-e30f166270ad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:34.118854 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ef33dc9-accc-4091-a755-e30f166270ad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:34.119667 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ef33dc9-accc-4091-a755-e30f166270ad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:34.257148 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4ef33dc9-accc-4091-a755-e30f166270ad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:34.265728 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4ef33dc9-accc-4091-a755-e30f166270ad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:34.267327 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4ef33dc9-accc-4091-a755-e30f166270ad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:34.268475 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4ef33dc9-accc-4091-a755-e30f166270ad tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.162513 Dec 15 14:11:34.269061 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 458/909] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:34 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:35.291449 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ab47fbf5-b866-426b-9752-026cae1b67fb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:35.292076 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ab47fbf5-b866-426b-9752-026cae1b67fb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:35.299303 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ab47fbf5-b866-426b-9752-026cae1b67fb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:35.299761 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ab47fbf5-b866-426b-9752-026cae1b67fb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:35.300545 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ab47fbf5-b866-426b-9752-026cae1b67fb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:35.300984 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ab47fbf5-b866-426b-9752-026cae1b67fb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:35.454605 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ab47fbf5-b866-426b-9752-026cae1b67fb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:35.471301 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ab47fbf5-b866-426b-9752-026cae1b67fb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:35.473774 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ab47fbf5-b866-426b-9752-026cae1b67fb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:35.475560 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ab47fbf5-b866-426b-9752-026cae1b67fb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.190020 Dec 15 14:11:35.476370 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 452/910] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:35 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:36.495655 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-59bff76d-e431-4aea-8adf-2e059471b307 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:36.496268 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-59bff76d-e431-4aea-8adf-2e059471b307 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:36.502612 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-59bff76d-e431-4aea-8adf-2e059471b307 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:36.503064 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-59bff76d-e431-4aea-8adf-2e059471b307 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:36.503886 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-59bff76d-e431-4aea-8adf-2e059471b307 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:36.504340 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-59bff76d-e431-4aea-8adf-2e059471b307 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:36.648023 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-59bff76d-e431-4aea-8adf-2e059471b307 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:36.661456 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-59bff76d-e431-4aea-8adf-2e059471b307 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:36.663898 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-59bff76d-e431-4aea-8adf-2e059471b307 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:36.665804 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-59bff76d-e431-4aea-8adf-2e059471b307 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.174020 Dec 15 14:11:36.667409 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 459/911] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:36 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:37.689450 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9b033920-72f4-4f82-8896-a800e0519591 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:37.690521 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9b033920-72f4-4f82-8896-a800e0519591 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:37.700252 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9b033920-72f4-4f82-8896-a800e0519591 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:37.700706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9b033920-72f4-4f82-8896-a800e0519591 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:37.701495 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9b033920-72f4-4f82-8896-a800e0519591 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:37.701973 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9b033920-72f4-4f82-8896-a800e0519591 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:37.841566 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9b033920-72f4-4f82-8896-a800e0519591 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:37.850963 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9b033920-72f4-4f82-8896-a800e0519591 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:37.852468 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9b033920-72f4-4f82-8896-a800e0519591 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:37.853726 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9b033920-72f4-4f82-8896-a800e0519591 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.170410 Dec 15 14:11:37.854645 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 453/912] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:37 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:38.873601 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bf5ecbc9-9f61-417f-b7f3-32ed928e21f7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:38.874530 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bf5ecbc9-9f61-417f-b7f3-32ed928e21f7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:38.882236 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf5ecbc9-9f61-417f-b7f3-32ed928e21f7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:38.882768 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf5ecbc9-9f61-417f-b7f3-32ed928e21f7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:38.883704 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf5ecbc9-9f61-417f-b7f3-32ed928e21f7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:38.884226 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf5ecbc9-9f61-417f-b7f3-32ed928e21f7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:39.027631 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bf5ecbc9-9f61-417f-b7f3-32ed928e21f7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:39.036066 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bf5ecbc9-9f61-417f-b7f3-32ed928e21f7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:39.037600 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bf5ecbc9-9f61-417f-b7f3-32ed928e21f7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:39.038802 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bf5ecbc9-9f61-417f-b7f3-32ed928e21f7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.170034 Dec 15 14:11:39.039352 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 460/913] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:38 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:40.059373 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-99dd0d3c-3813-4a99-b40b-91a5c97c3c82 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:40.059988 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-99dd0d3c-3813-4a99-b40b-91a5c97c3c82 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:40.066816 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99dd0d3c-3813-4a99-b40b-91a5c97c3c82 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:40.067275 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99dd0d3c-3813-4a99-b40b-91a5c97c3c82 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:40.068086 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99dd0d3c-3813-4a99-b40b-91a5c97c3c82 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:40.068545 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99dd0d3c-3813-4a99-b40b-91a5c97c3c82 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:40.210756 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-99dd0d3c-3813-4a99-b40b-91a5c97c3c82 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:40.219654 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-99dd0d3c-3813-4a99-b40b-91a5c97c3c82 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:40.221515 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-99dd0d3c-3813-4a99-b40b-91a5c97c3c82 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:40.222731 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-99dd0d3c-3813-4a99-b40b-91a5c97c3c82 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.168105 Dec 15 14:11:40.223303 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 454/914] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:40 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:41.241438 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dfca3244-d70a-4c74-86a3-067bf5105bba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:41.242056 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dfca3244-d70a-4c74-86a3-067bf5105bba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:41.248721 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dfca3244-d70a-4c74-86a3-067bf5105bba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:41.249184 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dfca3244-d70a-4c74-86a3-067bf5105bba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:41.250032 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dfca3244-d70a-4c74-86a3-067bf5105bba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:41.250460 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dfca3244-d70a-4c74-86a3-067bf5105bba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:41.399160 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dfca3244-d70a-4c74-86a3-067bf5105bba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:41.408187 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dfca3244-d70a-4c74-86a3-067bf5105bba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:41.409811 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dfca3244-d70a-4c74-86a3-067bf5105bba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:41.411069 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dfca3244-d70a-4c74-86a3-067bf5105bba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.173377 Dec 15 14:11:41.411645 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 461/915] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:41 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:42.433640 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-64940722-5900-4c76-9b6e-ae038f91a332 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:42.434242 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-64940722-5900-4c76-9b6e-ae038f91a332 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:42.441953 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-64940722-5900-4c76-9b6e-ae038f91a332 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:42.442514 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-64940722-5900-4c76-9b6e-ae038f91a332 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:42.443398 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-64940722-5900-4c76-9b6e-ae038f91a332 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:42.443924 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-64940722-5900-4c76-9b6e-ae038f91a332 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:42.794971 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:11:42.795233 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:11:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da (ip 10.222.0.42) !!! Dec 15 14:11:42.821383 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-64940722-5900-4c76-9b6e-ae038f91a332 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:42.830230 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-64940722-5900-4c76-9b6e-ae038f91a332 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:42.831759 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-64940722-5900-4c76-9b6e-ae038f91a332 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:42.832934 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-64940722-5900-4c76-9b6e-ae038f91a332 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.404211 Dec 15 14:11:42.833489 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 455/916] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:42 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:43.855804 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-99268f03-273d-4da5-9d29-bd665446d9ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:43.856771 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-99268f03-273d-4da5-9d29-bd665446d9ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:43.868482 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99268f03-273d-4da5-9d29-bd665446d9ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:43.869357 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99268f03-273d-4da5-9d29-bd665446d9ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:43.870748 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99268f03-273d-4da5-9d29-bd665446d9ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:43.871493 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99268f03-273d-4da5-9d29-bd665446d9ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:44.011773 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-99268f03-273d-4da5-9d29-bd665446d9ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:44.020949 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-99268f03-273d-4da5-9d29-bd665446d9ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:44.022458 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-99268f03-273d-4da5-9d29-bd665446d9ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:44.023610 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-99268f03-273d-4da5-9d29-bd665446d9ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.173965 Dec 15 14:11:44.024181 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 462/917] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:43 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:45.045838 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-acca2c68-0b72-4a8e-9e38-f330e18952ce tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:45.046392 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-acca2c68-0b72-4a8e-9e38-f330e18952ce tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:45.053176 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-acca2c68-0b72-4a8e-9e38-f330e18952ce tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:45.053643 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-acca2c68-0b72-4a8e-9e38-f330e18952ce tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:45.054504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-acca2c68-0b72-4a8e-9e38-f330e18952ce tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:45.054929 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-acca2c68-0b72-4a8e-9e38-f330e18952ce tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:45.192489 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-acca2c68-0b72-4a8e-9e38-f330e18952ce tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:45.201792 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-acca2c68-0b72-4a8e-9e38-f330e18952ce tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:45.203272 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-acca2c68-0b72-4a8e-9e38-f330e18952ce tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:45.204413 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-acca2c68-0b72-4a8e-9e38-f330e18952ce tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.164406 Dec 15 14:11:45.204980 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 456/918] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:45 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:46.227899 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-92d25691-bed6-418a-ad68-cc69becd53a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:46.228885 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-92d25691-bed6-418a-ad68-cc69becd53a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:46.239956 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92d25691-bed6-418a-ad68-cc69becd53a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:46.240707 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92d25691-bed6-418a-ad68-cc69becd53a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:46.242101 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92d25691-bed6-418a-ad68-cc69becd53a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:46.242809 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92d25691-bed6-418a-ad68-cc69becd53a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:46.389898 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-92d25691-bed6-418a-ad68-cc69becd53a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:46.398612 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-92d25691-bed6-418a-ad68-cc69becd53a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:46.400148 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-92d25691-bed6-418a-ad68-cc69becd53a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:46.401391 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-92d25691-bed6-418a-ad68-cc69becd53a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.179976 Dec 15 14:11:46.402138 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 463/919] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:46 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:47.424820 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ebcf0a0c-5a68-44ae-9957-04daa9f52f6b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:47.425845 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ebcf0a0c-5a68-44ae-9957-04daa9f52f6b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:47.436437 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ebcf0a0c-5a68-44ae-9957-04daa9f52f6b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:47.436887 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ebcf0a0c-5a68-44ae-9957-04daa9f52f6b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:47.437664 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ebcf0a0c-5a68-44ae-9957-04daa9f52f6b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:47.438129 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ebcf0a0c-5a68-44ae-9957-04daa9f52f6b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:47.580919 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ebcf0a0c-5a68-44ae-9957-04daa9f52f6b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:47.593525 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ebcf0a0c-5a68-44ae-9957-04daa9f52f6b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:47.595348 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ebcf0a0c-5a68-44ae-9957-04daa9f52f6b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:47.596507 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ebcf0a0c-5a68-44ae-9957-04daa9f52f6b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.178262 Dec 15 14:11:47.597075 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 457/920] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:47 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:48.622735 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a6add41f-2686-47a1-9dd6-61e3d4de5b0a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:48.623503 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a6add41f-2686-47a1-9dd6-61e3d4de5b0a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:48.630130 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a6add41f-2686-47a1-9dd6-61e3d4de5b0a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:48.630579 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a6add41f-2686-47a1-9dd6-61e3d4de5b0a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:48.631388 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a6add41f-2686-47a1-9dd6-61e3d4de5b0a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:48.631817 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a6add41f-2686-47a1-9dd6-61e3d4de5b0a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:48.768781 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a6add41f-2686-47a1-9dd6-61e3d4de5b0a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:48.777894 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a6add41f-2686-47a1-9dd6-61e3d4de5b0a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:48.779689 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a6add41f-2686-47a1-9dd6-61e3d4de5b0a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:48.780859 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a6add41f-2686-47a1-9dd6-61e3d4de5b0a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.162652 Dec 15 14:11:48.781458 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 464/921] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:48 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:49.799927 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7832ee3b-d36d-4687-858c-89848529346d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:49.800428 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7832ee3b-d36d-4687-858c-89848529346d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:49.807207 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7832ee3b-d36d-4687-858c-89848529346d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:49.807660 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7832ee3b-d36d-4687-858c-89848529346d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:49.808426 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7832ee3b-d36d-4687-858c-89848529346d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:49.808861 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7832ee3b-d36d-4687-858c-89848529346d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:49.948294 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7832ee3b-d36d-4687-858c-89848529346d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:49.957181 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7832ee3b-d36d-4687-858c-89848529346d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:49.958693 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7832ee3b-d36d-4687-858c-89848529346d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:49.959836 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7832ee3b-d36d-4687-858c-89848529346d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.164035 Dec 15 14:11:49.960373 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 458/922] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:49 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:50.979028 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-502e8689-63c0-4980-a6b7-9fb9a2f0fb94 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:50.979669 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-502e8689-63c0-4980-a6b7-9fb9a2f0fb94 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:50.986694 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-502e8689-63c0-4980-a6b7-9fb9a2f0fb94 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:50.987142 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-502e8689-63c0-4980-a6b7-9fb9a2f0fb94 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:50.987937 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-502e8689-63c0-4980-a6b7-9fb9a2f0fb94 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:50.988377 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-502e8689-63c0-4980-a6b7-9fb9a2f0fb94 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:51.127330 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-502e8689-63c0-4980-a6b7-9fb9a2f0fb94 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:51.136290 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-502e8689-63c0-4980-a6b7-9fb9a2f0fb94 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:51.137829 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-502e8689-63c0-4980-a6b7-9fb9a2f0fb94 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:51.139208 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-502e8689-63c0-4980-a6b7-9fb9a2f0fb94 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.163800 Dec 15 14:11:51.139748 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 465/923] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:50 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:52.160884 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-52d7b795-bf62-40c1-b576-683f747e1aa9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:52.161722 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-52d7b795-bf62-40c1-b576-683f747e1aa9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:52.171044 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-52d7b795-bf62-40c1-b576-683f747e1aa9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:52.171704 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-52d7b795-bf62-40c1-b576-683f747e1aa9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:52.172894 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-52d7b795-bf62-40c1-b576-683f747e1aa9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:52.173539 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-52d7b795-bf62-40c1-b576-683f747e1aa9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:52.315625 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-52d7b795-bf62-40c1-b576-683f747e1aa9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:52.324463 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-52d7b795-bf62-40c1-b576-683f747e1aa9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:52.326003 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-52d7b795-bf62-40c1-b576-683f747e1aa9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:52.327188 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-52d7b795-bf62-40c1-b576-683f747e1aa9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.172146 Dec 15 14:11:52.327728 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 459/924] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:52 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:53.347585 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7354c3e0-c7d9-4103-b7cd-1a7c829cc99b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:53.348152 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7354c3e0-c7d9-4103-b7cd-1a7c829cc99b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:53.355030 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7354c3e0-c7d9-4103-b7cd-1a7c829cc99b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:53.355484 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7354c3e0-c7d9-4103-b7cd-1a7c829cc99b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:53.356305 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7354c3e0-c7d9-4103-b7cd-1a7c829cc99b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:53.356746 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7354c3e0-c7d9-4103-b7cd-1a7c829cc99b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:53.517768 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7354c3e0-c7d9-4103-b7cd-1a7c829cc99b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:53.526744 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7354c3e0-c7d9-4103-b7cd-1a7c829cc99b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:53.528230 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7354c3e0-c7d9-4103-b7cd-1a7c829cc99b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:53.529397 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7354c3e0-c7d9-4103-b7cd-1a7c829cc99b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.186776 Dec 15 14:11:53.530008 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 466/925] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:53 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:54.551316 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5605d2fc-08b1-42a0-84db-bab49074bb9c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:54.551911 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5605d2fc-08b1-42a0-84db-bab49074bb9c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:54.559018 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5605d2fc-08b1-42a0-84db-bab49074bb9c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:54.559475 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5605d2fc-08b1-42a0-84db-bab49074bb9c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:54.560257 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5605d2fc-08b1-42a0-84db-bab49074bb9c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:54.560691 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5605d2fc-08b1-42a0-84db-bab49074bb9c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:54.703207 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5605d2fc-08b1-42a0-84db-bab49074bb9c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:54.712184 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5605d2fc-08b1-42a0-84db-bab49074bb9c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:54.713663 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5605d2fc-08b1-42a0-84db-bab49074bb9c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:54.714872 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5605d2fc-08b1-42a0-84db-bab49074bb9c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.168765 Dec 15 14:11:54.715477 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 460/926] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:54 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:55.738193 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-78266df0-2ffa-4221-9509-3b09d06546a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:55.738854 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-78266df0-2ffa-4221-9509-3b09d06546a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:55.749811 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78266df0-2ffa-4221-9509-3b09d06546a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:55.750551 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78266df0-2ffa-4221-9509-3b09d06546a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:55.751995 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78266df0-2ffa-4221-9509-3b09d06546a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:55.752821 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78266df0-2ffa-4221-9509-3b09d06546a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:55.894688 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-78266df0-2ffa-4221-9509-3b09d06546a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:55.904318 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-78266df0-2ffa-4221-9509-3b09d06546a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:55.907812 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-78266df0-2ffa-4221-9509-3b09d06546a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:55.909489 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-78266df0-2ffa-4221-9509-3b09d06546a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.177329 Dec 15 14:11:55.910093 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 467/927] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:55 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:56.928235 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d4efc80f-3d9b-4835-8aba-de0bcd31efac tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:56.928842 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d4efc80f-3d9b-4835-8aba-de0bcd31efac tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:56.935748 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4efc80f-3d9b-4835-8aba-de0bcd31efac tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:56.936207 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4efc80f-3d9b-4835-8aba-de0bcd31efac tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:56.937006 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4efc80f-3d9b-4835-8aba-de0bcd31efac tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:56.937535 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4efc80f-3d9b-4835-8aba-de0bcd31efac tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:57.083265 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d4efc80f-3d9b-4835-8aba-de0bcd31efac tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:57.097505 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d4efc80f-3d9b-4835-8aba-de0bcd31efac tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:57.099392 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d4efc80f-3d9b-4835-8aba-de0bcd31efac tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:57.100580 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d4efc80f-3d9b-4835-8aba-de0bcd31efac tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.176639 Dec 15 14:11:57.101116 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 461/928] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:56 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:58.127838 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5508c6f9-37fb-41b4-a2ff-9d8a673e816e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:58.128784 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5508c6f9-37fb-41b4-a2ff-9d8a673e816e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:58.139804 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5508c6f9-37fb-41b4-a2ff-9d8a673e816e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:58.140531 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5508c6f9-37fb-41b4-a2ff-9d8a673e816e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:58.141914 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5508c6f9-37fb-41b4-a2ff-9d8a673e816e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:58.142623 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5508c6f9-37fb-41b4-a2ff-9d8a673e816e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:58.291561 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5508c6f9-37fb-41b4-a2ff-9d8a673e816e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:58.304089 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5508c6f9-37fb-41b4-a2ff-9d8a673e816e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:58.305584 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5508c6f9-37fb-41b4-a2ff-9d8a673e816e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:58.306779 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5508c6f9-37fb-41b4-a2ff-9d8a673e816e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.185294 Dec 15 14:11:58.307334 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 468/929] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:58 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:59.329254 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-03c1f864-b22d-4557-b8c5-1d43b616c4e2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:59.330286 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-03c1f864-b22d-4557-b8c5-1d43b616c4e2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:11:59.341547 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03c1f864-b22d-4557-b8c5-1d43b616c4e2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:59.342346 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03c1f864-b22d-4557-b8c5-1d43b616c4e2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:59.343568 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03c1f864-b22d-4557-b8c5-1d43b616c4e2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:59.344322 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03c1f864-b22d-4557-b8c5-1d43b616c4e2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:59.488014 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-03c1f864-b22d-4557-b8c5-1d43b616c4e2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:59.500900 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-03c1f864-b22d-4557-b8c5-1d43b616c4e2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:59.503252 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-03c1f864-b22d-4557-b8c5-1d43b616c4e2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:11:59.504672 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-03c1f864-b22d-4557-b8c5-1d43b616c4e2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.181515 Dec 15 14:11:59.505429 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 462/930] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:11:59 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:00.523424 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7a8513f4-dd83-4ddf-befa-537b163c8125 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:00.524058 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7a8513f4-dd83-4ddf-befa-537b163c8125 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:00.534446 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a8513f4-dd83-4ddf-befa-537b163c8125 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:00.534895 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a8513f4-dd83-4ddf-befa-537b163c8125 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:00.535704 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a8513f4-dd83-4ddf-befa-537b163c8125 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:00.537911 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a8513f4-dd83-4ddf-befa-537b163c8125 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:00.693964 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7a8513f4-dd83-4ddf-befa-537b163c8125 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:00.708100 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7a8513f4-dd83-4ddf-befa-537b163c8125 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:00.710858 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7a8513f4-dd83-4ddf-befa-537b163c8125 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:00.713005 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7a8513f4-dd83-4ddf-befa-537b163c8125 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.193002 Dec 15 14:12:00.714036 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 469/931] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:00 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:01.221152 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8a91bcac-d9bf-44fc-bdf6-1eb0aa88ef92 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:12:01.222722 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8a91bcac-d9bf-44fc-bdf6-1eb0aa88ef92 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:01.229653 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a91bcac-d9bf-44fc-bdf6-1eb0aa88ef92 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:01.230301 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a91bcac-d9bf-44fc-bdf6-1eb0aa88ef92 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:01.231174 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a91bcac-d9bf-44fc-bdf6-1eb0aa88ef92 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:01.231747 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a91bcac-d9bf-44fc-bdf6-1eb0aa88ef92 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:01.267102 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-8a91bcac-d9bf-44fc-bdf6-1eb0aa88ef92 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lazy-loading 'flavor' on Instance uuid 12be41af-387a-4090-93dd-d26d8e97bf45 {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:12:01.362135 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8a91bcac-d9bf-44fc-bdf6-1eb0aa88ef92 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [a2b14dff-eb4a-4e0e-8c5e-33f3e4e9e959] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 14:12:01.736226 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e44fb57c-15c4-4bf5-b3f8-1eb2d13aace7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:01.736866 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e44fb57c-15c4-4bf5-b3f8-1eb2d13aace7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:01.751935 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e44fb57c-15c4-4bf5-b3f8-1eb2d13aace7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:01.752484 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e44fb57c-15c4-4bf5-b3f8-1eb2d13aace7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:01.753696 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e44fb57c-15c4-4bf5-b3f8-1eb2d13aace7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:01.754267 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e44fb57c-15c4-4bf5-b3f8-1eb2d13aace7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:01.895697 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e44fb57c-15c4-4bf5-b3f8-1eb2d13aace7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:01.904574 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e44fb57c-15c4-4bf5-b3f8-1eb2d13aace7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:01.906090 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e44fb57c-15c4-4bf5-b3f8-1eb2d13aace7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:01.907247 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e44fb57c-15c4-4bf5-b3f8-1eb2d13aace7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.177259 Dec 15 14:12:01.907996 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 470/932] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:01 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:02.379566 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [None req-8a91bcac-d9bf-44fc-bdf6-1eb0aa88ef92 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [a2b14dff-eb4a-4e0e-8c5e-33f3e4e9e959] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 48744. Dec 15 14:12:02.383394 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8a91bcac-d9bf-44fc-bdf6-1eb0aa88ef92 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "POST /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45/action" status: 202 len: 0 microversion: 2.1 time: 1.167159 Dec 15 14:12:02.384457 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 463/933] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:12:01 2021] POST /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45/action => generated 0 bytes in 1169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:12:02.393739 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6d468596-be5c-47f1-88a7-20361b37946f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:02.394486 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6d468596-be5c-47f1-88a7-20361b37946f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:02.402048 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d468596-be5c-47f1-88a7-20361b37946f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:02.402737 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d468596-be5c-47f1-88a7-20361b37946f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:02.403625 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d468596-be5c-47f1-88a7-20361b37946f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:02.404073 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d468596-be5c-47f1-88a7-20361b37946f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:02.554998 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6d468596-be5c-47f1-88a7-20361b37946f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:02.563188 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6d468596-be5c-47f1-88a7-20361b37946f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.173333 Dec 15 14:12:02.563731 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 471/934] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:02 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:02.930922 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-25dcb4f8-af34-4f80-9467-df132ecc2139 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:02.933325 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-25dcb4f8-af34-4f80-9467-df132ecc2139 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:02.942428 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-25dcb4f8-af34-4f80-9467-df132ecc2139 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:02.943164 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-25dcb4f8-af34-4f80-9467-df132ecc2139 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:02.944441 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-25dcb4f8-af34-4f80-9467-df132ecc2139 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:02.945147 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-25dcb4f8-af34-4f80-9467-df132ecc2139 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:03.087353 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-25dcb4f8-af34-4f80-9467-df132ecc2139 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:03.098953 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-25dcb4f8-af34-4f80-9467-df132ecc2139 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:03.101302 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-25dcb4f8-af34-4f80-9467-df132ecc2139 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:03.103059 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-25dcb4f8-af34-4f80-9467-df132ecc2139 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.178871 Dec 15 14:12:03.104014 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 464/935] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:02 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:03.585877 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f101d748-0117-4a9f-b51c-2c317eb7f2d8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:03.586931 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f101d748-0117-4a9f-b51c-2c317eb7f2d8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:03.594411 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f101d748-0117-4a9f-b51c-2c317eb7f2d8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:03.595186 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f101d748-0117-4a9f-b51c-2c317eb7f2d8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:03.595998 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f101d748-0117-4a9f-b51c-2c317eb7f2d8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:03.596442 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f101d748-0117-4a9f-b51c-2c317eb7f2d8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:03.740389 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f101d748-0117-4a9f-b51c-2c317eb7f2d8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:03.752667 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f101d748-0117-4a9f-b51c-2c317eb7f2d8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.172734 Dec 15 14:12:03.753460 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 472/936] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:03 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:04.122599 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d840e935-cebd-44af-942d-2f229cefe7bc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:04.123256 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d840e935-cebd-44af-942d-2f229cefe7bc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:04.130143 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d840e935-cebd-44af-942d-2f229cefe7bc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:04.130583 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d840e935-cebd-44af-942d-2f229cefe7bc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:04.131352 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d840e935-cebd-44af-942d-2f229cefe7bc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:04.131783 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d840e935-cebd-44af-942d-2f229cefe7bc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:04.271919 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d840e935-cebd-44af-942d-2f229cefe7bc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:04.280763 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d840e935-cebd-44af-942d-2f229cefe7bc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:04.282278 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d840e935-cebd-44af-942d-2f229cefe7bc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:04.283440 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d840e935-cebd-44af-942d-2f229cefe7bc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.164767 Dec 15 14:12:04.283996 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 465/937] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:04 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:04.777879 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7cad761c-78b1-44ab-9bf1-ca1c82e02a3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:04.778444 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7cad761c-78b1-44ab-9bf1-ca1c82e02a3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:04.784932 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7cad761c-78b1-44ab-9bf1-ca1c82e02a3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:04.785383 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7cad761c-78b1-44ab-9bf1-ca1c82e02a3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:04.786211 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7cad761c-78b1-44ab-9bf1-ca1c82e02a3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:04.786647 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7cad761c-78b1-44ab-9bf1-ca1c82e02a3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:04.935792 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7cad761c-78b1-44ab-9bf1-ca1c82e02a3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:04.944244 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7cad761c-78b1-44ab-9bf1-ca1c82e02a3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.172472 Dec 15 14:12:04.944856 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 473/938] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:04 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:05.302206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fcd64843-42c6-425b-8ed0-d13c0ff59f0e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:05.302775 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fcd64843-42c6-425b-8ed0-d13c0ff59f0e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:05.310118 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fcd64843-42c6-425b-8ed0-d13c0ff59f0e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:05.310621 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fcd64843-42c6-425b-8ed0-d13c0ff59f0e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:05.311423 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fcd64843-42c6-425b-8ed0-d13c0ff59f0e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:05.311857 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fcd64843-42c6-425b-8ed0-d13c0ff59f0e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:05.449115 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fcd64843-42c6-425b-8ed0-d13c0ff59f0e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:05.458263 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fcd64843-42c6-425b-8ed0-d13c0ff59f0e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:05.459709 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fcd64843-42c6-425b-8ed0-d13c0ff59f0e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:05.460865 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fcd64843-42c6-425b-8ed0-d13c0ff59f0e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.162584 Dec 15 14:12:05.461433 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 466/939] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:05 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:05.961929 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a0172d03-f07f-4c37-8085-f67b6253b8b5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:05.962525 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a0172d03-f07f-4c37-8085-f67b6253b8b5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:05.969913 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a0172d03-f07f-4c37-8085-f67b6253b8b5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:05.970360 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a0172d03-f07f-4c37-8085-f67b6253b8b5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:05.971283 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a0172d03-f07f-4c37-8085-f67b6253b8b5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:05.971720 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a0172d03-f07f-4c37-8085-f67b6253b8b5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:06.119035 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a0172d03-f07f-4c37-8085-f67b6253b8b5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:06.126609 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a0172d03-f07f-4c37-8085-f67b6253b8b5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.168558 Dec 15 14:12:06.127224 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 474/940] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:05 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:06.482227 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f059a38f-68f2-40d7-9dc8-4db641a94e6f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:06.483282 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f059a38f-68f2-40d7-9dc8-4db641a94e6f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:06.493049 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f059a38f-68f2-40d7-9dc8-4db641a94e6f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:06.493498 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f059a38f-68f2-40d7-9dc8-4db641a94e6f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:06.494539 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f059a38f-68f2-40d7-9dc8-4db641a94e6f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:06.495242 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f059a38f-68f2-40d7-9dc8-4db641a94e6f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:06.645464 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f059a38f-68f2-40d7-9dc8-4db641a94e6f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:06.654739 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f059a38f-68f2-40d7-9dc8-4db641a94e6f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:06.656167 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f059a38f-68f2-40d7-9dc8-4db641a94e6f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:06.657328 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f059a38f-68f2-40d7-9dc8-4db641a94e6f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.180960 Dec 15 14:12:06.657913 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 467/941] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:06 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:07.148106 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1756eaf3-bdd5-417c-b43a-b8cd69e6b0db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:07.149084 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1756eaf3-bdd5-417c-b43a-b8cd69e6b0db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:07.156970 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1756eaf3-bdd5-417c-b43a-b8cd69e6b0db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:07.157422 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1756eaf3-bdd5-417c-b43a-b8cd69e6b0db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:07.158252 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1756eaf3-bdd5-417c-b43a-b8cd69e6b0db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:07.158693 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1756eaf3-bdd5-417c-b43a-b8cd69e6b0db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:07.301009 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1756eaf3-bdd5-417c-b43a-b8cd69e6b0db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:07.310290 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1756eaf3-bdd5-417c-b43a-b8cd69e6b0db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.168315 Dec 15 14:12:07.311235 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 475/942] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:07 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:07.680027 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ca9b850e-092a-4fb2-86c5-7b5a5676df63 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:07.681085 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ca9b850e-092a-4fb2-86c5-7b5a5676df63 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:07.689336 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca9b850e-092a-4fb2-86c5-7b5a5676df63 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:07.689821 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca9b850e-092a-4fb2-86c5-7b5a5676df63 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:07.690605 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca9b850e-092a-4fb2-86c5-7b5a5676df63 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:07.691041 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca9b850e-092a-4fb2-86c5-7b5a5676df63 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:07.857177 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ca9b850e-092a-4fb2-86c5-7b5a5676df63 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:07.865827 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ca9b850e-092a-4fb2-86c5-7b5a5676df63 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:07.867329 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ca9b850e-092a-4fb2-86c5-7b5a5676df63 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:07.868501 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ca9b850e-092a-4fb2-86c5-7b5a5676df63 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.194892 Dec 15 14:12:07.869118 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 468/943] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:07 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:08.330545 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e36bd372-3da3-486d-8360-f53e4009df23 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:08.331298 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e36bd372-3da3-486d-8360-f53e4009df23 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:08.340524 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e36bd372-3da3-486d-8360-f53e4009df23 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:08.341098 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e36bd372-3da3-486d-8360-f53e4009df23 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:08.342129 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e36bd372-3da3-486d-8360-f53e4009df23 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:08.342673 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e36bd372-3da3-486d-8360-f53e4009df23 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:08.492005 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e36bd372-3da3-486d-8360-f53e4009df23 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:08.501830 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e36bd372-3da3-486d-8360-f53e4009df23 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.175975 Dec 15 14:12:08.502376 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 476/944] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:08 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:08.888659 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e347300e-598f-483f-ac20-0648a7accab9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:08.889376 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e347300e-598f-483f-ac20-0648a7accab9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:08.896204 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e347300e-598f-483f-ac20-0648a7accab9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:08.896657 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e347300e-598f-483f-ac20-0648a7accab9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:08.897420 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e347300e-598f-483f-ac20-0648a7accab9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:08.897889 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e347300e-598f-483f-ac20-0648a7accab9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:09.036870 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e347300e-598f-483f-ac20-0648a7accab9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:09.046337 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e347300e-598f-483f-ac20-0648a7accab9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:09.047839 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e347300e-598f-483f-ac20-0648a7accab9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:09.049037 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e347300e-598f-483f-ac20-0648a7accab9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.164858 Dec 15 14:12:09.049601 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 469/945] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:08 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:09.520696 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-99dccd75-7d46-43ca-9b44-d7365bab1e3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:09.521439 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-99dccd75-7d46-43ca-9b44-d7365bab1e3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:09.529461 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99dccd75-7d46-43ca-9b44-d7365bab1e3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:09.529970 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99dccd75-7d46-43ca-9b44-d7365bab1e3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:09.530817 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99dccd75-7d46-43ca-9b44-d7365bab1e3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:09.531248 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99dccd75-7d46-43ca-9b44-d7365bab1e3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:09.676720 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-99dccd75-7d46-43ca-9b44-d7365bab1e3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:09.688122 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-99dccd75-7d46-43ca-9b44-d7365bab1e3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.171551 Dec 15 14:12:09.688965 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 477/946] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:09 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:10.072509 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b8502686-bc1c-40ce-af66-27bdbad895d6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:10.073371 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b8502686-bc1c-40ce-af66-27bdbad895d6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:10.085244 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8502686-bc1c-40ce-af66-27bdbad895d6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:10.086028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8502686-bc1c-40ce-af66-27bdbad895d6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:10.087333 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8502686-bc1c-40ce-af66-27bdbad895d6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:10.088046 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8502686-bc1c-40ce-af66-27bdbad895d6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:10.234954 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b8502686-bc1c-40ce-af66-27bdbad895d6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:10.247119 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b8502686-bc1c-40ce-af66-27bdbad895d6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:10.248762 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b8502686-bc1c-40ce-af66-27bdbad895d6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:10.249985 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b8502686-bc1c-40ce-af66-27bdbad895d6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.184132 Dec 15 14:12:10.250549 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 470/947] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:10 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:10.710302 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7d2c6d50-6d2c-4629-b3fd-2a74f602aff9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:10.710930 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7d2c6d50-6d2c-4629-b3fd-2a74f602aff9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:10.718125 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7d2c6d50-6d2c-4629-b3fd-2a74f602aff9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:10.718569 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7d2c6d50-6d2c-4629-b3fd-2a74f602aff9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:10.719695 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7d2c6d50-6d2c-4629-b3fd-2a74f602aff9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:10.720155 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7d2c6d50-6d2c-4629-b3fd-2a74f602aff9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:10.868149 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7d2c6d50-6d2c-4629-b3fd-2a74f602aff9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:10.876263 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7d2c6d50-6d2c-4629-b3fd-2a74f602aff9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.169742 Dec 15 14:12:10.876845 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 478/948] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:10 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:11.268827 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d0f8babc-a30a-40ad-a841-630509e80723 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:11.269404 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d0f8babc-a30a-40ad-a841-630509e80723 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:11.275805 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0f8babc-a30a-40ad-a841-630509e80723 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:11.276245 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0f8babc-a30a-40ad-a841-630509e80723 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:11.277055 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0f8babc-a30a-40ad-a841-630509e80723 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:11.277501 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0f8babc-a30a-40ad-a841-630509e80723 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:11.423714 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d0f8babc-a30a-40ad-a841-630509e80723 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:11.432386 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d0f8babc-a30a-40ad-a841-630509e80723 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:11.433974 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d0f8babc-a30a-40ad-a841-630509e80723 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:11.435151 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d0f8babc-a30a-40ad-a841-630509e80723 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.170191 Dec 15 14:12:11.435724 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 471/949] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:11 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:11.897840 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-21a2baa4-041f-421f-845f-986d9a9a7458 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:11.898819 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-21a2baa4-041f-421f-845f-986d9a9a7458 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:11.910111 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21a2baa4-041f-421f-845f-986d9a9a7458 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:11.910775 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21a2baa4-041f-421f-845f-986d9a9a7458 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:11.912539 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21a2baa4-041f-421f-845f-986d9a9a7458 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:11.913311 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21a2baa4-041f-421f-845f-986d9a9a7458 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:12.067985 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-21a2baa4-041f-421f-845f-986d9a9a7458 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:12.076169 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-21a2baa4-041f-421f-845f-986d9a9a7458 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.184787 Dec 15 14:12:12.076735 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 479/950] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:11 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:12.458727 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-899dd8ba-f1d7-4dcf-becc-4758b214fad4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:12.459702 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-899dd8ba-f1d7-4dcf-becc-4758b214fad4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:12.468512 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-899dd8ba-f1d7-4dcf-becc-4758b214fad4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:12.468971 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-899dd8ba-f1d7-4dcf-becc-4758b214fad4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:12.470144 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-899dd8ba-f1d7-4dcf-becc-4758b214fad4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:12.470578 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-899dd8ba-f1d7-4dcf-becc-4758b214fad4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:12.621482 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-899dd8ba-f1d7-4dcf-becc-4758b214fad4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:12.631196 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-899dd8ba-f1d7-4dcf-becc-4758b214fad4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:12.632730 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-899dd8ba-f1d7-4dcf-becc-4758b214fad4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:12.634005 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-899dd8ba-f1d7-4dcf-becc-4758b214fad4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.181796 Dec 15 14:12:12.634590 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 472/951] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:12 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:13.093781 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2940754f-c61b-4f55-a167-be8d378ade12 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:13.094871 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2940754f-c61b-4f55-a167-be8d378ade12 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:13.101537 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2940754f-c61b-4f55-a167-be8d378ade12 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:13.102017 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2940754f-c61b-4f55-a167-be8d378ade12 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:13.102839 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2940754f-c61b-4f55-a167-be8d378ade12 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:13.103276 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2940754f-c61b-4f55-a167-be8d378ade12 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:13.274861 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2940754f-c61b-4f55-a167-be8d378ade12 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:13.284134 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2940754f-c61b-4f55-a167-be8d378ade12 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.194298 Dec 15 14:12:13.284682 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 480/952] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:13 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:13.653392 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-308bc636-c76b-4d24-82dd-afdcc2cb5527 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:13.654193 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-308bc636-c76b-4d24-82dd-afdcc2cb5527 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:13.663456 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-308bc636-c76b-4d24-82dd-afdcc2cb5527 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:13.664036 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-308bc636-c76b-4d24-82dd-afdcc2cb5527 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:13.665260 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-308bc636-c76b-4d24-82dd-afdcc2cb5527 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:13.666003 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-308bc636-c76b-4d24-82dd-afdcc2cb5527 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:13.822354 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-308bc636-c76b-4d24-82dd-afdcc2cb5527 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:13.832398 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-308bc636-c76b-4d24-82dd-afdcc2cb5527 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:13.833941 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-308bc636-c76b-4d24-82dd-afdcc2cb5527 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:13.835107 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-308bc636-c76b-4d24-82dd-afdcc2cb5527 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.185951 Dec 15 14:12:13.835653 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 473/953] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:13 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:14.305193 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ad137c10-56a0-45f2-8965-99886edc406f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:14.306243 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ad137c10-56a0-45f2-8965-99886edc406f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:14.320454 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad137c10-56a0-45f2-8965-99886edc406f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:14.322805 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad137c10-56a0-45f2-8965-99886edc406f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:14.322805 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad137c10-56a0-45f2-8965-99886edc406f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:14.323192 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad137c10-56a0-45f2-8965-99886edc406f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:14.476897 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ad137c10-56a0-45f2-8965-99886edc406f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:14.491230 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ad137c10-56a0-45f2-8965-99886edc406f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.191950 Dec 15 14:12:14.492144 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 481/954] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:14 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:14.857491 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d15a05c9-554b-49c5-bc33-0cd563937b4b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:14.858333 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d15a05c9-554b-49c5-bc33-0cd563937b4b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:14.865247 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d15a05c9-554b-49c5-bc33-0cd563937b4b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:14.865687 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d15a05c9-554b-49c5-bc33-0cd563937b4b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:14.866585 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d15a05c9-554b-49c5-bc33-0cd563937b4b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:14.867030 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d15a05c9-554b-49c5-bc33-0cd563937b4b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:15.008111 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d15a05c9-554b-49c5-bc33-0cd563937b4b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:15.016976 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d15a05c9-554b-49c5-bc33-0cd563937b4b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:15.018508 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d15a05c9-554b-49c5-bc33-0cd563937b4b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:15.019675 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d15a05c9-554b-49c5-bc33-0cd563937b4b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.166780 Dec 15 14:12:15.020255 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 474/955] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:14 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:15.513600 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-865d7f96-7dd8-40d0-8061-d1e89a1f69df tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:15.514257 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-865d7f96-7dd8-40d0-8061-d1e89a1f69df tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:15.524065 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-865d7f96-7dd8-40d0-8061-d1e89a1f69df tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:15.524685 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-865d7f96-7dd8-40d0-8061-d1e89a1f69df tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:15.525924 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-865d7f96-7dd8-40d0-8061-d1e89a1f69df tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:15.526562 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-865d7f96-7dd8-40d0-8061-d1e89a1f69df tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:15.671170 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-865d7f96-7dd8-40d0-8061-d1e89a1f69df tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:15.679107 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-865d7f96-7dd8-40d0-8061-d1e89a1f69df tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.171682 Dec 15 14:12:15.679681 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 482/956] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:15 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:16.041602 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e2b5ac0f-98a1-474a-ba60-d7f0f609a503 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:16.045245 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e2b5ac0f-98a1-474a-ba60-d7f0f609a503 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:16.052786 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2b5ac0f-98a1-474a-ba60-d7f0f609a503 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:16.053528 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2b5ac0f-98a1-474a-ba60-d7f0f609a503 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:16.054793 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2b5ac0f-98a1-474a-ba60-d7f0f609a503 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:16.055467 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2b5ac0f-98a1-474a-ba60-d7f0f609a503 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:16.205780 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e2b5ac0f-98a1-474a-ba60-d7f0f609a503 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:16.214891 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e2b5ac0f-98a1-474a-ba60-d7f0f609a503 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:16.216611 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e2b5ac0f-98a1-474a-ba60-d7f0f609a503 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:16.217859 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e2b5ac0f-98a1-474a-ba60-d7f0f609a503 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.182368 Dec 15 14:12:16.218425 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 475/957] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:16 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:16.700779 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8f89fa7f-3682-44f2-8506-0e6fb2699ebe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:16.701485 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8f89fa7f-3682-44f2-8506-0e6fb2699ebe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:16.708318 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f89fa7f-3682-44f2-8506-0e6fb2699ebe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:16.708772 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f89fa7f-3682-44f2-8506-0e6fb2699ebe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:16.709566 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f89fa7f-3682-44f2-8506-0e6fb2699ebe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:16.710054 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f89fa7f-3682-44f2-8506-0e6fb2699ebe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:16.854376 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8f89fa7f-3682-44f2-8506-0e6fb2699ebe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:16.862343 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8f89fa7f-3682-44f2-8506-0e6fb2699ebe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.165573 Dec 15 14:12:16.862896 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 483/958] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:16 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:17.241387 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-71ad00f8-bdfb-4e1f-88c3-b5ca48b83766 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:17.242402 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-71ad00f8-bdfb-4e1f-88c3-b5ca48b83766 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:17.253156 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71ad00f8-bdfb-4e1f-88c3-b5ca48b83766 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:17.253993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71ad00f8-bdfb-4e1f-88c3-b5ca48b83766 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:17.255294 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71ad00f8-bdfb-4e1f-88c3-b5ca48b83766 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:17.256057 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71ad00f8-bdfb-4e1f-88c3-b5ca48b83766 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:17.394949 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-71ad00f8-bdfb-4e1f-88c3-b5ca48b83766 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:17.407208 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-71ad00f8-bdfb-4e1f-88c3-b5ca48b83766 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:17.408714 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-71ad00f8-bdfb-4e1f-88c3-b5ca48b83766 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:17.409914 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-71ad00f8-bdfb-4e1f-88c3-b5ca48b83766 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.174940 Dec 15 14:12:17.410495 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 476/959] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:17 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:17.725816 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-31fcb7f1-81c1-470a-a1a3-cf65e68c576a req-30752611-fd52-48f2-b0f6-5d730493d87f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12be41af-387a-4090-93dd-d26d8e97bf45", "name": "network-vif-unplugged", "status": "completed", "tag": "ffe19195-444e-423e-ac6a-9120626e5ae8"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:12:17.727934 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:12:17.727934 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:12:17.742647 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-31fcb7f1-81c1-470a-a1a3-cf65e68c576a req-30752611-fd52-48f2-b0f6-5d730493d87f service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:17.743208 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-31fcb7f1-81c1-470a-a1a3-cf65e68c576a req-30752611-fd52-48f2-b0f6-5d730493d87f service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:17.757011 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-31fcb7f1-81c1-470a-a1a3-cf65e68c576a req-30752611-fd52-48f2-b0f6-5d730493d87f service nova] Creating event network-vif-unplugged:ffe19195-444e-423e-ac6a-9120626e5ae8 for instance 12be41af-387a-4090-93dd-d26d8e97bf45 on hv-cinder-82182 Dec 15 14:12:17.762367 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-31fcb7f1-81c1-470a-a1a3-cf65e68c576a req-30752611-fd52-48f2-b0f6-5d730493d87f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040487 Dec 15 14:12:17.763171 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 484/960] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:12:17 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:12:17.888947 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c04d6b5f-a74b-4140-a993-7e5d48faea3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:17.889782 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c04d6b5f-a74b-4140-a993-7e5d48faea3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:17.897122 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c04d6b5f-a74b-4140-a993-7e5d48faea3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:17.897448 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c04d6b5f-a74b-4140-a993-7e5d48faea3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:17.898276 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c04d6b5f-a74b-4140-a993-7e5d48faea3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:17.898716 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c04d6b5f-a74b-4140-a993-7e5d48faea3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:18.054815 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c04d6b5f-a74b-4140-a993-7e5d48faea3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:18.066277 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c04d6b5f-a74b-4140-a993-7e5d48faea3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.187668 Dec 15 14:12:18.067232 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 477/961] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:17 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:18.433413 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d18a5193-5107-4ae1-8ca9-08883e7bf901 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:18.434634 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d18a5193-5107-4ae1-8ca9-08883e7bf901 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:18.442433 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d18a5193-5107-4ae1-8ca9-08883e7bf901 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:18.442884 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d18a5193-5107-4ae1-8ca9-08883e7bf901 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:18.443663 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d18a5193-5107-4ae1-8ca9-08883e7bf901 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:18.444095 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d18a5193-5107-4ae1-8ca9-08883e7bf901 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:18.593649 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d18a5193-5107-4ae1-8ca9-08883e7bf901 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:18.606987 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d18a5193-5107-4ae1-8ca9-08883e7bf901 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:18.609026 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d18a5193-5107-4ae1-8ca9-08883e7bf901 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:18.610245 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d18a5193-5107-4ae1-8ca9-08883e7bf901 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.183686 Dec 15 14:12:18.610813 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 485/962] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:18 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:19.091512 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1d62adb8-c31f-4d5d-b1ad-206698d8fd7b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:19.092609 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1d62adb8-c31f-4d5d-b1ad-206698d8fd7b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:19.099741 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d62adb8-c31f-4d5d-b1ad-206698d8fd7b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:19.100205 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d62adb8-c31f-4d5d-b1ad-206698d8fd7b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:19.100996 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d62adb8-c31f-4d5d-b1ad-206698d8fd7b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:19.101418 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d62adb8-c31f-4d5d-b1ad-206698d8fd7b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:19.243309 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1d62adb8-c31f-4d5d-b1ad-206698d8fd7b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:19.254491 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1d62adb8-c31f-4d5d-b1ad-206698d8fd7b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.169446 Dec 15 14:12:19.255340 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 478/963] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:19 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:19.630223 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9aabe3c5-7fd8-4ce6-b3eb-03a0ebaa7280 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:19.630842 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9aabe3c5-7fd8-4ce6-b3eb-03a0ebaa7280 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:19.637549 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9aabe3c5-7fd8-4ce6-b3eb-03a0ebaa7280 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:19.638030 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9aabe3c5-7fd8-4ce6-b3eb-03a0ebaa7280 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:19.638805 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9aabe3c5-7fd8-4ce6-b3eb-03a0ebaa7280 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:19.639236 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9aabe3c5-7fd8-4ce6-b3eb-03a0ebaa7280 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:19.782471 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9aabe3c5-7fd8-4ce6-b3eb-03a0ebaa7280 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:19.791275 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9aabe3c5-7fd8-4ce6-b3eb-03a0ebaa7280 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:19.792778 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9aabe3c5-7fd8-4ce6-b3eb-03a0ebaa7280 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:19.794056 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9aabe3c5-7fd8-4ce6-b3eb-03a0ebaa7280 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.167714 Dec 15 14:12:19.794620 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 486/964] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:19 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:20.280153 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6e1bf0fd-d87c-4d3c-a2cd-ce9e3720c038 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:20.281871 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6e1bf0fd-d87c-4d3c-a2cd-ce9e3720c038 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:20.292370 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6e1bf0fd-d87c-4d3c-a2cd-ce9e3720c038 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:20.293121 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6e1bf0fd-d87c-4d3c-a2cd-ce9e3720c038 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:20.295004 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6e1bf0fd-d87c-4d3c-a2cd-ce9e3720c038 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:20.295738 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6e1bf0fd-d87c-4d3c-a2cd-ce9e3720c038 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:20.432391 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6e1bf0fd-d87c-4d3c-a2cd-ce9e3720c038 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:20.441208 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6e1bf0fd-d87c-4d3c-a2cd-ce9e3720c038 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.167844 Dec 15 14:12:20.441814 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 479/965] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:20 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:20.812946 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bf6ad9ea-78fa-41de-b08b-b8e278624e99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:20.813562 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bf6ad9ea-78fa-41de-b08b-b8e278624e99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:20.820676 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf6ad9ea-78fa-41de-b08b-b8e278624e99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:20.821120 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf6ad9ea-78fa-41de-b08b-b8e278624e99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:20.821919 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf6ad9ea-78fa-41de-b08b-b8e278624e99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:20.822350 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf6ad9ea-78fa-41de-b08b-b8e278624e99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:20.978179 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bf6ad9ea-78fa-41de-b08b-b8e278624e99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:20.987174 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bf6ad9ea-78fa-41de-b08b-b8e278624e99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:20.988705 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bf6ad9ea-78fa-41de-b08b-b8e278624e99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:20.989942 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bf6ad9ea-78fa-41de-b08b-b8e278624e99 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.181222 Dec 15 14:12:20.990506 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 487/966] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:20 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:21.468819 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-47ab21d1-b841-4574-bf28-91d72a8b6e42 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:21.469850 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-47ab21d1-b841-4574-bf28-91d72a8b6e42 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:21.476953 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47ab21d1-b841-4574-bf28-91d72a8b6e42 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:21.477422 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47ab21d1-b841-4574-bf28-91d72a8b6e42 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:21.478275 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47ab21d1-b841-4574-bf28-91d72a8b6e42 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:21.478710 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47ab21d1-b841-4574-bf28-91d72a8b6e42 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:21.624303 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-47ab21d1-b841-4574-bf28-91d72a8b6e42 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:21.636138 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-47ab21d1-b841-4574-bf28-91d72a8b6e42 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.173617 Dec 15 14:12:21.636911 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 480/967] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:21 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:22.012847 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3122d3bc-766a-4086-9ab8-8933d9094b1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:22.014171 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3122d3bc-766a-4086-9ab8-8933d9094b1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:22.025858 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3122d3bc-766a-4086-9ab8-8933d9094b1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:22.026616 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3122d3bc-766a-4086-9ab8-8933d9094b1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:22.027962 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3122d3bc-766a-4086-9ab8-8933d9094b1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:22.028696 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3122d3bc-766a-4086-9ab8-8933d9094b1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:22.179763 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3122d3bc-766a-4086-9ab8-8933d9094b1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:22.191197 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3122d3bc-766a-4086-9ab8-8933d9094b1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:22.192689 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3122d3bc-766a-4086-9ab8-8933d9094b1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:22.193899 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3122d3bc-766a-4086-9ab8-8933d9094b1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.187418 Dec 15 14:12:22.194456 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 488/968] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:22 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:22.657548 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-58293389-c124-4cce-966c-32f787dbdd89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:22.658873 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-58293389-c124-4cce-966c-32f787dbdd89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:22.666613 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-58293389-c124-4cce-966c-32f787dbdd89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:22.667177 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-58293389-c124-4cce-966c-32f787dbdd89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:22.668157 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-58293389-c124-4cce-966c-32f787dbdd89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:22.668697 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-58293389-c124-4cce-966c-32f787dbdd89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:22.810665 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-58293389-c124-4cce-966c-32f787dbdd89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:22.819123 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-58293389-c124-4cce-966c-32f787dbdd89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.167483 Dec 15 14:12:22.819702 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 481/969] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:22 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:23.216517 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-80447d8b-e3de-48ff-b623-3f62e03ac706 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:23.217192 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-80447d8b-e3de-48ff-b623-3f62e03ac706 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:23.227415 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80447d8b-e3de-48ff-b623-3f62e03ac706 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:23.228028 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80447d8b-e3de-48ff-b623-3f62e03ac706 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:23.229160 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80447d8b-e3de-48ff-b623-3f62e03ac706 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:23.229834 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80447d8b-e3de-48ff-b623-3f62e03ac706 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:23.372081 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-80447d8b-e3de-48ff-b623-3f62e03ac706 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:23.382073 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-80447d8b-e3de-48ff-b623-3f62e03ac706 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:23.383545 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-80447d8b-e3de-48ff-b623-3f62e03ac706 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:23.384840 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-80447d8b-e3de-48ff-b623-3f62e03ac706 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.174144 Dec 15 14:12:23.385444 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 489/970] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:23 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:23.838784 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-63721383-a3c3-4f58-8085-65b24b9332d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:23.839654 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-63721383-a3c3-4f58-8085-65b24b9332d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:23.850144 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-63721383-a3c3-4f58-8085-65b24b9332d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:23.850800 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-63721383-a3c3-4f58-8085-65b24b9332d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:23.851923 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-63721383-a3c3-4f58-8085-65b24b9332d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:23.852515 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-63721383-a3c3-4f58-8085-65b24b9332d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:24.015814 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-63721383-a3c3-4f58-8085-65b24b9332d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:24.023928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-63721383-a3c3-4f58-8085-65b24b9332d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.190524 Dec 15 14:12:24.024500 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 482/971] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:23 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:24.408246 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e7648aa4-9d0a-45c4-9c3d-f1c5e1fec313 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:24.408989 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e7648aa4-9d0a-45c4-9c3d-f1c5e1fec313 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:24.417243 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e7648aa4-9d0a-45c4-9c3d-f1c5e1fec313 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:24.417886 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e7648aa4-9d0a-45c4-9c3d-f1c5e1fec313 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:24.418875 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e7648aa4-9d0a-45c4-9c3d-f1c5e1fec313 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:24.419424 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e7648aa4-9d0a-45c4-9c3d-f1c5e1fec313 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:24.565887 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e7648aa4-9d0a-45c4-9c3d-f1c5e1fec313 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:24.574962 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e7648aa4-9d0a-45c4-9c3d-f1c5e1fec313 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:24.576468 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e7648aa4-9d0a-45c4-9c3d-f1c5e1fec313 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:24.577648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e7648aa4-9d0a-45c4-9c3d-f1c5e1fec313 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.175070 Dec 15 14:12:24.578240 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 490/972] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:24 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:25.045048 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-85366787-4210-4606-9944-1fde62f0fb24 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:25.045922 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-85366787-4210-4606-9944-1fde62f0fb24 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:25.056449 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85366787-4210-4606-9944-1fde62f0fb24 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:25.057197 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85366787-4210-4606-9944-1fde62f0fb24 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:25.058635 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85366787-4210-4606-9944-1fde62f0fb24 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:25.059264 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85366787-4210-4606-9944-1fde62f0fb24 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:25.203532 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-85366787-4210-4606-9944-1fde62f0fb24 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:25.211047 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-85366787-4210-4606-9944-1fde62f0fb24 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.172354 Dec 15 14:12:25.211623 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 483/973] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:25 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:25.597454 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b70c1227-2b2e-4db7-aaae-cb5522bd6e27 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:25.598341 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b70c1227-2b2e-4db7-aaae-cb5522bd6e27 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:25.605152 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b70c1227-2b2e-4db7-aaae-cb5522bd6e27 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:25.605628 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b70c1227-2b2e-4db7-aaae-cb5522bd6e27 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:25.606441 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b70c1227-2b2e-4db7-aaae-cb5522bd6e27 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:25.606885 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b70c1227-2b2e-4db7-aaae-cb5522bd6e27 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:25.851530 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b70c1227-2b2e-4db7-aaae-cb5522bd6e27 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:25.860298 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b70c1227-2b2e-4db7-aaae-cb5522bd6e27 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:25.861824 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b70c1227-2b2e-4db7-aaae-cb5522bd6e27 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:25.862993 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b70c1227-2b2e-4db7-aaae-cb5522bd6e27 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1751 microversion: 2.20 time: 0.269748 Dec 15 14:12:25.863551 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 491/974] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:25 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1751 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:26.229982 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dbc34afa-c9c9-4fdb-a060-29f21603ddbe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:26.230594 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dbc34afa-c9c9-4fdb-a060-29f21603ddbe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:26.237823 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dbc34afa-c9c9-4fdb-a060-29f21603ddbe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:26.238280 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dbc34afa-c9c9-4fdb-a060-29f21603ddbe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:26.239063 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dbc34afa-c9c9-4fdb-a060-29f21603ddbe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:26.239495 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dbc34afa-c9c9-4fdb-a060-29f21603ddbe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:26.392377 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dbc34afa-c9c9-4fdb-a060-29f21603ddbe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:26.400511 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dbc34afa-c9c9-4fdb-a060-29f21603ddbe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.174458 Dec 15 14:12:26.401083 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 484/975] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:26 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:26.883147 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5de9373a-cad7-4aff-b472-36dcec2d2173 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:26.884015 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5de9373a-cad7-4aff-b472-36dcec2d2173 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:26.893097 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5de9373a-cad7-4aff-b472-36dcec2d2173 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:26.893545 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5de9373a-cad7-4aff-b472-36dcec2d2173 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:26.894362 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5de9373a-cad7-4aff-b472-36dcec2d2173 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:26.894787 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5de9373a-cad7-4aff-b472-36dcec2d2173 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:27.035202 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5de9373a-cad7-4aff-b472-36dcec2d2173 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:27.044441 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5de9373a-cad7-4aff-b472-36dcec2d2173 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:27.046108 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5de9373a-cad7-4aff-b472-36dcec2d2173 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:27.047362 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5de9373a-cad7-4aff-b472-36dcec2d2173 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.169851 Dec 15 14:12:27.047940 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 492/976] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:26 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:27.423316 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6e46706e-a7cf-4f2c-b848-67a61122fb67 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:27.424355 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6e46706e-a7cf-4f2c-b848-67a61122fb67 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:27.435216 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6e46706e-a7cf-4f2c-b848-67a61122fb67 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:27.435950 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6e46706e-a7cf-4f2c-b848-67a61122fb67 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:27.437273 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6e46706e-a7cf-4f2c-b848-67a61122fb67 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:27.438104 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6e46706e-a7cf-4f2c-b848-67a61122fb67 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:27.586540 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6e46706e-a7cf-4f2c-b848-67a61122fb67 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:27.599010 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6e46706e-a7cf-4f2c-b848-67a61122fb67 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.182500 Dec 15 14:12:27.599816 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 485/977] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:27 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:28.075644 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b1d26bd5-71d6-40b6-83be-7e94e99cc3cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:28.076523 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b1d26bd5-71d6-40b6-83be-7e94e99cc3cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:28.087685 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1d26bd5-71d6-40b6-83be-7e94e99cc3cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:28.088445 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1d26bd5-71d6-40b6-83be-7e94e99cc3cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:28.089793 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1d26bd5-71d6-40b6-83be-7e94e99cc3cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:28.090569 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1d26bd5-71d6-40b6-83be-7e94e99cc3cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:28.239019 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b1d26bd5-71d6-40b6-83be-7e94e99cc3cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:28.252323 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b1d26bd5-71d6-40b6-83be-7e94e99cc3cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:28.254740 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b1d26bd5-71d6-40b6-83be-7e94e99cc3cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:28.256523 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b1d26bd5-71d6-40b6-83be-7e94e99cc3cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.187169 Dec 15 14:12:28.257306 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 493/978] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:28 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:28.619981 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f525cab9-d6fa-4cf6-ba3a-58e3b50f43cd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:28.620684 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f525cab9-d6fa-4cf6-ba3a-58e3b50f43cd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:28.629189 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f525cab9-d6fa-4cf6-ba3a-58e3b50f43cd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:28.629646 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f525cab9-d6fa-4cf6-ba3a-58e3b50f43cd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:28.630452 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f525cab9-d6fa-4cf6-ba3a-58e3b50f43cd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:28.630893 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f525cab9-d6fa-4cf6-ba3a-58e3b50f43cd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:28.768829 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f525cab9-d6fa-4cf6-ba3a-58e3b50f43cd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:28.776951 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f525cab9-d6fa-4cf6-ba3a-58e3b50f43cd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.163098 Dec 15 14:12:28.777535 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 486/979] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:28 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:29.282735 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1b1ebec8-4ec7-4dee-9fb6-94c459deb300 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:29.283623 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1b1ebec8-4ec7-4dee-9fb6-94c459deb300 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:29.294487 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b1ebec8-4ec7-4dee-9fb6-94c459deb300 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:29.295242 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b1ebec8-4ec7-4dee-9fb6-94c459deb300 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:29.296539 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b1ebec8-4ec7-4dee-9fb6-94c459deb300 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:29.297457 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b1ebec8-4ec7-4dee-9fb6-94c459deb300 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:29.443733 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1b1ebec8-4ec7-4dee-9fb6-94c459deb300 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:29.452266 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1b1ebec8-4ec7-4dee-9fb6-94c459deb300 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:29.454051 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1b1ebec8-4ec7-4dee-9fb6-94c459deb300 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:29.455249 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1b1ebec8-4ec7-4dee-9fb6-94c459deb300 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.179197 Dec 15 14:12:29.455797 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 494/980] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:29 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:29.796168 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e677196c-fbd5-40e4-a23d-4c5d3669b380 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:29.796748 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e677196c-fbd5-40e4-a23d-4c5d3669b380 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:29.803714 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e677196c-fbd5-40e4-a23d-4c5d3669b380 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:29.804177 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e677196c-fbd5-40e4-a23d-4c5d3669b380 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:29.804950 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e677196c-fbd5-40e4-a23d-4c5d3669b380 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:29.805377 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e677196c-fbd5-40e4-a23d-4c5d3669b380 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:29.949570 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e677196c-fbd5-40e4-a23d-4c5d3669b380 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:29.957441 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e677196c-fbd5-40e4-a23d-4c5d3669b380 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.165157 Dec 15 14:12:29.958036 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 487/981] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:29 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:30.483750 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d39ac604-068f-48f7-afb4-850632a7d180 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:30.484729 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d39ac604-068f-48f7-afb4-850632a7d180 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:30.493071 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d39ac604-068f-48f7-afb4-850632a7d180 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:30.493516 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d39ac604-068f-48f7-afb4-850632a7d180 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:30.494342 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d39ac604-068f-48f7-afb4-850632a7d180 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:30.494773 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d39ac604-068f-48f7-afb4-850632a7d180 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:30.647424 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d39ac604-068f-48f7-afb4-850632a7d180 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:30.656093 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d39ac604-068f-48f7-afb4-850632a7d180 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:30.657950 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d39ac604-068f-48f7-afb4-850632a7d180 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:30.658902 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d39ac604-068f-48f7-afb4-850632a7d180 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.181887 Dec 15 14:12:30.659463 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 495/982] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:30 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:30.978831 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1e8bf6a8-21de-4a94-8fac-52bc88787e2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:30.979435 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1e8bf6a8-21de-4a94-8fac-52bc88787e2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:30.986501 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e8bf6a8-21de-4a94-8fac-52bc88787e2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:30.986953 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e8bf6a8-21de-4a94-8fac-52bc88787e2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:30.987740 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e8bf6a8-21de-4a94-8fac-52bc88787e2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:30.988175 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e8bf6a8-21de-4a94-8fac-52bc88787e2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:31.132334 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1e8bf6a8-21de-4a94-8fac-52bc88787e2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:31.140284 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1e8bf6a8-21de-4a94-8fac-52bc88787e2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.165173 Dec 15 14:12:31.140833 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 488/983] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:30 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:31.681144 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-403383f6-242a-4886-a8cc-67c1c230f844 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:31.682118 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-403383f6-242a-4886-a8cc-67c1c230f844 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:31.691490 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-403383f6-242a-4886-a8cc-67c1c230f844 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:31.691931 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-403383f6-242a-4886-a8cc-67c1c230f844 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:31.692721 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-403383f6-242a-4886-a8cc-67c1c230f844 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:31.693145 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-403383f6-242a-4886-a8cc-67c1c230f844 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:31.837266 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-403383f6-242a-4886-a8cc-67c1c230f844 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:31.846185 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-403383f6-242a-4886-a8cc-67c1c230f844 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:31.847686 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-403383f6-242a-4886-a8cc-67c1c230f844 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:31.848868 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-403383f6-242a-4886-a8cc-67c1c230f844 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.174020 Dec 15 14:12:31.849430 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 496/984] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:31 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:32.158845 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e64dd923-c73c-449e-aed1-a55afc23b41f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:32.159569 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e64dd923-c73c-449e-aed1-a55afc23b41f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:32.167141 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e64dd923-c73c-449e-aed1-a55afc23b41f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:32.167663 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e64dd923-c73c-449e-aed1-a55afc23b41f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:32.168558 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e64dd923-c73c-449e-aed1-a55afc23b41f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:32.169061 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e64dd923-c73c-449e-aed1-a55afc23b41f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:32.313924 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e64dd923-c73c-449e-aed1-a55afc23b41f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:32.323851 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e64dd923-c73c-449e-aed1-a55afc23b41f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.169036 Dec 15 14:12:32.324608 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 489/985] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:32 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:32.877939 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-03a49686-db98-4651-8d6e-252c21e2f13c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:32.879008 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-03a49686-db98-4651-8d6e-252c21e2f13c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:32.889902 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-03a49686-db98-4651-8d6e-252c21e2f13c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:32.890662 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-03a49686-db98-4651-8d6e-252c21e2f13c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:32.892033 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-03a49686-db98-4651-8d6e-252c21e2f13c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:32.892506 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-03a49686-db98-4651-8d6e-252c21e2f13c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:33.038320 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-03a49686-db98-4651-8d6e-252c21e2f13c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:33.048756 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-03a49686-db98-4651-8d6e-252c21e2f13c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:33.050300 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-03a49686-db98-4651-8d6e-252c21e2f13c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:33.051595 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-03a49686-db98-4651-8d6e-252c21e2f13c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.180363 Dec 15 14:12:33.052163 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 497/986] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:32 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:33.451924 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-70a9316e-3875-4143-aef7-60629b25ba26 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:33.452488 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-70a9316e-3875-4143-aef7-60629b25ba26 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:33.458989 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-70a9316e-3875-4143-aef7-60629b25ba26 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:33.459418 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-70a9316e-3875-4143-aef7-60629b25ba26 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:33.460198 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-70a9316e-3875-4143-aef7-60629b25ba26 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:33.460631 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-70a9316e-3875-4143-aef7-60629b25ba26 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:33.612998 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-70a9316e-3875-4143-aef7-60629b25ba26 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:33.625260 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-70a9316e-3875-4143-aef7-60629b25ba26 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.279238 Dec 15 14:12:33.626103 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 490/987] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:33 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:34.073751 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-22ac125e-e152-40a9-9785-1791f0f682e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:34.074299 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-22ac125e-e152-40a9-9785-1791f0f682e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:34.084892 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22ac125e-e152-40a9-9785-1791f0f682e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:34.085344 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22ac125e-e152-40a9-9785-1791f0f682e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:34.086175 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22ac125e-e152-40a9-9785-1791f0f682e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:34.086620 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22ac125e-e152-40a9-9785-1791f0f682e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:34.232844 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-22ac125e-e152-40a9-9785-1791f0f682e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:34.241403 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-22ac125e-e152-40a9-9785-1791f0f682e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:34.242918 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-22ac125e-e152-40a9-9785-1791f0f682e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:34.244078 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-22ac125e-e152-40a9-9785-1791f0f682e9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.175050 Dec 15 14:12:34.244631 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 498/988] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:34 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:34.649101 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-78790037-dad0-447e-bfb7-787943c4cef5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:34.649777 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-78790037-dad0-447e-bfb7-787943c4cef5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:34.656632 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-78790037-dad0-447e-bfb7-787943c4cef5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:34.657076 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-78790037-dad0-447e-bfb7-787943c4cef5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:34.658072 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-78790037-dad0-447e-bfb7-787943c4cef5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:34.658504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-78790037-dad0-447e-bfb7-787943c4cef5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:34.808683 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-78790037-dad0-447e-bfb7-787943c4cef5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:34.817911 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-78790037-dad0-447e-bfb7-787943c4cef5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.172608 Dec 15 14:12:34.819008 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 491/989] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:34 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:35.262527 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ab174448-3c07-4c79-881c-d98ad905f47d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:35.263108 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ab174448-3c07-4c79-881c-d98ad905f47d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:35.269397 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab174448-3c07-4c79-881c-d98ad905f47d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:35.269945 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab174448-3c07-4c79-881c-d98ad905f47d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:35.270809 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab174448-3c07-4c79-881c-d98ad905f47d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:35.271316 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab174448-3c07-4c79-881c-d98ad905f47d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:35.418809 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ab174448-3c07-4c79-881c-d98ad905f47d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:35.432023 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ab174448-3c07-4c79-881c-d98ad905f47d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:35.434425 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ab174448-3c07-4c79-881c-d98ad905f47d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:35.436209 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ab174448-3c07-4c79-881c-d98ad905f47d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.177067 Dec 15 14:12:35.437029 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 499/990] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:35 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:12:35.835549 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-323c3f81-b9ac-4e82-aed0-f114bd31db17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:35.836164 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-323c3f81-b9ac-4e82-aed0-f114bd31db17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:35.842899 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-323c3f81-b9ac-4e82-aed0-f114bd31db17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:35.843377 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-323c3f81-b9ac-4e82-aed0-f114bd31db17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:35.845164 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-323c3f81-b9ac-4e82-aed0-f114bd31db17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:35.845596 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-323c3f81-b9ac-4e82-aed0-f114bd31db17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:35.995703 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-323c3f81-b9ac-4e82-aed0-f114bd31db17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:36.004268 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-323c3f81-b9ac-4e82-aed0-f114bd31db17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.173065 Dec 15 14:12:36.004826 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 492/991] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:35 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:36.459887 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8eb3b077-d446-4a4f-8a3f-8bcef732ea0f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:36.460888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8eb3b077-d446-4a4f-8a3f-8bcef732ea0f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:36.470910 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8eb3b077-d446-4a4f-8a3f-8bcef732ea0f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:36.471813 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8eb3b077-d446-4a4f-8a3f-8bcef732ea0f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:36.473066 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8eb3b077-d446-4a4f-8a3f-8bcef732ea0f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:36.473796 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8eb3b077-d446-4a4f-8a3f-8bcef732ea0f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:36.622289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8eb3b077-d446-4a4f-8a3f-8bcef732ea0f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:36.634631 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8eb3b077-d446-4a4f-8a3f-8bcef732ea0f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:36.636981 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8eb3b077-d446-4a4f-8a3f-8bcef732ea0f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:36.638647 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8eb3b077-d446-4a4f-8a3f-8bcef732ea0f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.184751 Dec 15 14:12:36.639191 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 500/992] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:36 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:37.025206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-17ed66c6-444b-4fbe-aa48-e4e00db3cacd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:37.026284 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-17ed66c6-444b-4fbe-aa48-e4e00db3cacd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:37.036448 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17ed66c6-444b-4fbe-aa48-e4e00db3cacd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:37.036830 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17ed66c6-444b-4fbe-aa48-e4e00db3cacd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:37.037651 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17ed66c6-444b-4fbe-aa48-e4e00db3cacd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:37.038101 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17ed66c6-444b-4fbe-aa48-e4e00db3cacd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:37.187799 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-17ed66c6-444b-4fbe-aa48-e4e00db3cacd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:37.199963 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-17ed66c6-444b-4fbe-aa48-e4e00db3cacd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.180687 Dec 15 14:12:37.200776 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 493/993] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:37 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:37.662022 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0967eebf-c539-464a-812a-bd2ad55fc80d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:37.662643 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0967eebf-c539-464a-812a-bd2ad55fc80d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:37.669322 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0967eebf-c539-464a-812a-bd2ad55fc80d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:37.669801 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0967eebf-c539-464a-812a-bd2ad55fc80d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:37.670571 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0967eebf-c539-464a-812a-bd2ad55fc80d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:37.671007 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0967eebf-c539-464a-812a-bd2ad55fc80d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:37.825981 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0967eebf-c539-464a-812a-bd2ad55fc80d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:37.837230 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0967eebf-c539-464a-812a-bd2ad55fc80d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:37.838769 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0967eebf-c539-464a-812a-bd2ad55fc80d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:37.839971 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0967eebf-c539-464a-812a-bd2ad55fc80d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.183739 Dec 15 14:12:37.840537 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 501/994] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:37 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:38.224487 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b0ca2467-c77d-4f44-a0ef-bf1acb1013ca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:38.225063 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b0ca2467-c77d-4f44-a0ef-bf1acb1013ca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:38.232003 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0ca2467-c77d-4f44-a0ef-bf1acb1013ca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:38.232450 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0ca2467-c77d-4f44-a0ef-bf1acb1013ca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:38.233226 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0ca2467-c77d-4f44-a0ef-bf1acb1013ca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:38.233667 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0ca2467-c77d-4f44-a0ef-bf1acb1013ca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:38.377846 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b0ca2467-c77d-4f44-a0ef-bf1acb1013ca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:38.385901 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b0ca2467-c77d-4f44-a0ef-bf1acb1013ca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.167824 Dec 15 14:12:38.386435 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 494/995] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:38 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:38.863798 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-edd8257e-9d07-4a84-834e-2538b9fe40d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:38.864544 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-edd8257e-9d07-4a84-834e-2538b9fe40d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:38.871213 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-edd8257e-9d07-4a84-834e-2538b9fe40d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:38.871669 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-edd8257e-9d07-4a84-834e-2538b9fe40d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:38.872471 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-edd8257e-9d07-4a84-834e-2538b9fe40d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:38.872901 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-edd8257e-9d07-4a84-834e-2538b9fe40d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:39.014293 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-edd8257e-9d07-4a84-834e-2538b9fe40d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:39.027967 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-edd8257e-9d07-4a84-834e-2538b9fe40d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:39.030680 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-edd8257e-9d07-4a84-834e-2538b9fe40d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:39.032422 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-edd8257e-9d07-4a84-834e-2538b9fe40d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.172265 Dec 15 14:12:39.033364 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 502/996] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:38 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:39.403070 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b1a191ae-8169-4342-8631-15738d2451ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:39.403684 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b1a191ae-8169-4342-8631-15738d2451ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:39.410465 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1a191ae-8169-4342-8631-15738d2451ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:39.410963 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1a191ae-8169-4342-8631-15738d2451ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:39.411852 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1a191ae-8169-4342-8631-15738d2451ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:39.412311 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1a191ae-8169-4342-8631-15738d2451ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:39.771771 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b1a191ae-8169-4342-8631-15738d2451ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:39.779878 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b1a191ae-8169-4342-8631-15738d2451ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.380485 Dec 15 14:12:39.780497 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 495/997] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:39 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:40.055567 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8494195d-2f03-40c5-9863-0e89bf3e07f4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:40.056338 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8494195d-2f03-40c5-9863-0e89bf3e07f4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:40.066892 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8494195d-2f03-40c5-9863-0e89bf3e07f4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:40.067592 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8494195d-2f03-40c5-9863-0e89bf3e07f4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:40.068712 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8494195d-2f03-40c5-9863-0e89bf3e07f4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:40.069164 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8494195d-2f03-40c5-9863-0e89bf3e07f4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:40.222032 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8494195d-2f03-40c5-9863-0e89bf3e07f4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:40.231349 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8494195d-2f03-40c5-9863-0e89bf3e07f4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:40.232852 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8494195d-2f03-40c5-9863-0e89bf3e07f4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:40.234081 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8494195d-2f03-40c5-9863-0e89bf3e07f4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.185214 Dec 15 14:12:40.234618 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 503/998] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:40 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:40.797749 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-074bca95-0fe5-462f-9e13-443d32a3391f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:40.798352 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-074bca95-0fe5-462f-9e13-443d32a3391f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:40.805385 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-074bca95-0fe5-462f-9e13-443d32a3391f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:40.805856 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-074bca95-0fe5-462f-9e13-443d32a3391f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:40.806627 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-074bca95-0fe5-462f-9e13-443d32a3391f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:40.807056 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-074bca95-0fe5-462f-9e13-443d32a3391f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:40.972882 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-074bca95-0fe5-462f-9e13-443d32a3391f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:40.981016 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-074bca95-0fe5-462f-9e13-443d32a3391f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.187112 Dec 15 14:12:40.981525 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 496/999] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:40 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:41.256205 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f5bf96a6-cf16-46d0-a0fe-928014ccd921 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:41.256783 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f5bf96a6-cf16-46d0-a0fe-928014ccd921 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:41.263651 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5bf96a6-cf16-46d0-a0fe-928014ccd921 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:41.264100 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5bf96a6-cf16-46d0-a0fe-928014ccd921 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:41.264886 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5bf96a6-cf16-46d0-a0fe-928014ccd921 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:41.265330 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5bf96a6-cf16-46d0-a0fe-928014ccd921 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:41.408162 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f5bf96a6-cf16-46d0-a0fe-928014ccd921 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:41.419038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f5bf96a6-cf16-46d0-a0fe-928014ccd921 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:41.420526 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f5bf96a6-cf16-46d0-a0fe-928014ccd921 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:41.421816 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f5bf96a6-cf16-46d0-a0fe-928014ccd921 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.171940 Dec 15 14:12:41.422391 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 504/1000] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:41 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:41.999568 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2c997835-a548-42e1-b17e-93a0a73fc525 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:42.000172 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2c997835-a548-42e1-b17e-93a0a73fc525 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:42.008647 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c997835-a548-42e1-b17e-93a0a73fc525 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:42.009093 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c997835-a548-42e1-b17e-93a0a73fc525 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:42.009894 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c997835-a548-42e1-b17e-93a0a73fc525 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:42.010326 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c997835-a548-42e1-b17e-93a0a73fc525 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:42.163572 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2c997835-a548-42e1-b17e-93a0a73fc525 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:42.171097 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2c997835-a548-42e1-b17e-93a0a73fc525 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.175768 Dec 15 14:12:42.171676 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 497/1001] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:41 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:42.443027 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-44ad11eb-ef26-46ae-acd0-6f6bbdf5a177 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:42.444035 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-44ad11eb-ef26-46ae-acd0-6f6bbdf5a177 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:42.453517 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-44ad11eb-ef26-46ae-acd0-6f6bbdf5a177 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:42.454233 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-44ad11eb-ef26-46ae-acd0-6f6bbdf5a177 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:42.455343 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-44ad11eb-ef26-46ae-acd0-6f6bbdf5a177 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:42.455950 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-44ad11eb-ef26-46ae-acd0-6f6bbdf5a177 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:42.598968 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-44ad11eb-ef26-46ae-acd0-6f6bbdf5a177 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:42.607566 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-44ad11eb-ef26-46ae-acd0-6f6bbdf5a177 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:42.609080 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-44ad11eb-ef26-46ae-acd0-6f6bbdf5a177 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:42.610296 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-44ad11eb-ef26-46ae-acd0-6f6bbdf5a177 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.172781 Dec 15 14:12:42.610861 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 505/1002] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:42 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:43.198558 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a64d6dea-e0f2-4651-be93-cc63728ec3d7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:43.199541 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a64d6dea-e0f2-4651-be93-cc63728ec3d7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:43.210201 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a64d6dea-e0f2-4651-be93-cc63728ec3d7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:43.210656 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a64d6dea-e0f2-4651-be93-cc63728ec3d7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:43.211444 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a64d6dea-e0f2-4651-be93-cc63728ec3d7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:43.211868 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a64d6dea-e0f2-4651-be93-cc63728ec3d7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:43.360768 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a64d6dea-e0f2-4651-be93-cc63728ec3d7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:43.370182 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a64d6dea-e0f2-4651-be93-cc63728ec3d7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.178544 Dec 15 14:12:43.370751 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 498/1003] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:43 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:43.629650 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1e60a69b-1408-4fe7-8e6b-929ef3780021 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:43.630351 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1e60a69b-1408-4fe7-8e6b-929ef3780021 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:43.637032 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e60a69b-1408-4fe7-8e6b-929ef3780021 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:43.637567 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e60a69b-1408-4fe7-8e6b-929ef3780021 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:43.638555 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e60a69b-1408-4fe7-8e6b-929ef3780021 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:43.639009 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e60a69b-1408-4fe7-8e6b-929ef3780021 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:43.797153 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1e60a69b-1408-4fe7-8e6b-929ef3780021 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:43.810939 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1e60a69b-1408-4fe7-8e6b-929ef3780021 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:43.812441 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1e60a69b-1408-4fe7-8e6b-929ef3780021 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:43.813640 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1e60a69b-1408-4fe7-8e6b-929ef3780021 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.187796 Dec 15 14:12:43.814196 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 506/1004] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:43 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:44.391474 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-60ddcbcf-05f4-4b05-afee-c14a3eac5ed8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:44.392419 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-60ddcbcf-05f4-4b05-afee-c14a3eac5ed8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:44.403392 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60ddcbcf-05f4-4b05-afee-c14a3eac5ed8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:44.404145 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60ddcbcf-05f4-4b05-afee-c14a3eac5ed8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:44.405434 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60ddcbcf-05f4-4b05-afee-c14a3eac5ed8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:44.406218 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60ddcbcf-05f4-4b05-afee-c14a3eac5ed8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:44.548472 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-60ddcbcf-05f4-4b05-afee-c14a3eac5ed8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:44.556769 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-60ddcbcf-05f4-4b05-afee-c14a3eac5ed8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.171512 Dec 15 14:12:44.557341 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 499/1005] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:44 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:44.832852 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1cc28a46-6a9b-4603-ae9f-bc76ceab86d0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:44.833284 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1cc28a46-6a9b-4603-ae9f-bc76ceab86d0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:44.840361 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1cc28a46-6a9b-4603-ae9f-bc76ceab86d0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:44.840818 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1cc28a46-6a9b-4603-ae9f-bc76ceab86d0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:44.841689 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1cc28a46-6a9b-4603-ae9f-bc76ceab86d0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:44.842084 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1cc28a46-6a9b-4603-ae9f-bc76ceab86d0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:44.980947 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1cc28a46-6a9b-4603-ae9f-bc76ceab86d0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:44.992004 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1cc28a46-6a9b-4603-ae9f-bc76ceab86d0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:44.993505 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1cc28a46-6a9b-4603-ae9f-bc76ceab86d0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:44.994693 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1cc28a46-6a9b-4603-ae9f-bc76ceab86d0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.166079 Dec 15 14:12:44.995233 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 507/1006] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:44 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:45.574560 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-276330be-c293-42f0-88d3-11c2667a5475 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:45.575202 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-276330be-c293-42f0-88d3-11c2667a5475 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:45.582398 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-276330be-c293-42f0-88d3-11c2667a5475 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:45.582864 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-276330be-c293-42f0-88d3-11c2667a5475 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:45.583676 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-276330be-c293-42f0-88d3-11c2667a5475 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:45.584128 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-276330be-c293-42f0-88d3-11c2667a5475 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:45.734781 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-276330be-c293-42f0-88d3-11c2667a5475 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:45.742272 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-276330be-c293-42f0-88d3-11c2667a5475 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.171723 Dec 15 14:12:45.742842 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 500/1007] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:45 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:46.020815 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8890c726-809c-494f-b274-83e58bb70be5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:46.021464 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8890c726-809c-494f-b274-83e58bb70be5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:46.030513 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8890c726-809c-494f-b274-83e58bb70be5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:46.031241 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8890c726-809c-494f-b274-83e58bb70be5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:46.032842 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8890c726-809c-494f-b274-83e58bb70be5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:46.033558 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8890c726-809c-494f-b274-83e58bb70be5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:46.184246 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8890c726-809c-494f-b274-83e58bb70be5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:46.192736 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8890c726-809c-494f-b274-83e58bb70be5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:46.194285 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8890c726-809c-494f-b274-83e58bb70be5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:46.195437 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8890c726-809c-494f-b274-83e58bb70be5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.180700 Dec 15 14:12:46.196020 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 508/1008] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:46 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:46.762382 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8176747d-5ace-44d0-8f2e-e9869f3ca0ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:46.762382 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8176747d-5ace-44d0-8f2e-e9869f3ca0ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:46.769205 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8176747d-5ace-44d0-8f2e-e9869f3ca0ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:46.769649 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8176747d-5ace-44d0-8f2e-e9869f3ca0ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:46.770515 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8176747d-5ace-44d0-8f2e-e9869f3ca0ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:46.770937 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8176747d-5ace-44d0-8f2e-e9869f3ca0ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:46.916214 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8176747d-5ace-44d0-8f2e-e9869f3ca0ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:46.925105 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8176747d-5ace-44d0-8f2e-e9869f3ca0ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.167050 Dec 15 14:12:46.926008 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 501/1009] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:46 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:47.220304 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-087b5f76-aa28-4073-a8ec-6bbbfcc8e5dd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:47.220866 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-087b5f76-aa28-4073-a8ec-6bbbfcc8e5dd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:47.227943 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-087b5f76-aa28-4073-a8ec-6bbbfcc8e5dd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:47.228421 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-087b5f76-aa28-4073-a8ec-6bbbfcc8e5dd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:47.229193 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-087b5f76-aa28-4073-a8ec-6bbbfcc8e5dd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:47.229649 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-087b5f76-aa28-4073-a8ec-6bbbfcc8e5dd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:47.366477 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-087b5f76-aa28-4073-a8ec-6bbbfcc8e5dd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:47.375439 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-087b5f76-aa28-4073-a8ec-6bbbfcc8e5dd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:47.376922 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-087b5f76-aa28-4073-a8ec-6bbbfcc8e5dd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:47.378108 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-087b5f76-aa28-4073-a8ec-6bbbfcc8e5dd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.161994 Dec 15 14:12:47.378647 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 509/1010] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:47 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:47.945784 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0c278fac-1bfb-4c78-b26b-5059d77de3ae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:47.946421 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0c278fac-1bfb-4c78-b26b-5059d77de3ae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:47.953949 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0c278fac-1bfb-4c78-b26b-5059d77de3ae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:47.954439 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0c278fac-1bfb-4c78-b26b-5059d77de3ae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:47.955293 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0c278fac-1bfb-4c78-b26b-5059d77de3ae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:47.955766 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0c278fac-1bfb-4c78-b26b-5059d77de3ae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:48.110594 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0c278fac-1bfb-4c78-b26b-5059d77de3ae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:48.121336 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0c278fac-1bfb-4c78-b26b-5059d77de3ae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.180771 Dec 15 14:12:48.122098 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 502/1011] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:47 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:48.400038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b631b2ce-797b-4cc3-a87b-94a46c24a61e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:48.400714 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b631b2ce-797b-4cc3-a87b-94a46c24a61e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:48.408668 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b631b2ce-797b-4cc3-a87b-94a46c24a61e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:48.409199 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b631b2ce-797b-4cc3-a87b-94a46c24a61e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:48.410169 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b631b2ce-797b-4cc3-a87b-94a46c24a61e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:48.410690 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b631b2ce-797b-4cc3-a87b-94a46c24a61e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:48.554725 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b631b2ce-797b-4cc3-a87b-94a46c24a61e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:48.564121 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b631b2ce-797b-4cc3-a87b-94a46c24a61e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:48.565646 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b631b2ce-797b-4cc3-a87b-94a46c24a61e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:48.566825 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b631b2ce-797b-4cc3-a87b-94a46c24a61e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.172218 Dec 15 14:12:48.567421 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 510/1012] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:48 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:49.145898 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b96220e7-5106-40b4-9d12-c53bcadd6126 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:49.146632 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b96220e7-5106-40b4-9d12-c53bcadd6126 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:49.154120 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b96220e7-5106-40b4-9d12-c53bcadd6126 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:49.154573 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b96220e7-5106-40b4-9d12-c53bcadd6126 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:49.155360 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b96220e7-5106-40b4-9d12-c53bcadd6126 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:49.155799 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b96220e7-5106-40b4-9d12-c53bcadd6126 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:49.321881 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b96220e7-5106-40b4-9d12-c53bcadd6126 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:49.333755 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b96220e7-5106-40b4-9d12-c53bcadd6126 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.193782 Dec 15 14:12:49.334610 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 503/1013] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:49 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:49.589400 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-66953432-68c2-42c0-949f-a2887f2d97a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:49.590231 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-66953432-68c2-42c0-949f-a2887f2d97a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:49.601091 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66953432-68c2-42c0-949f-a2887f2d97a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:49.601567 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66953432-68c2-42c0-949f-a2887f2d97a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:49.602394 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66953432-68c2-42c0-949f-a2887f2d97a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:49.602832 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66953432-68c2-42c0-949f-a2887f2d97a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:49.763459 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-66953432-68c2-42c0-949f-a2887f2d97a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:49.775311 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-66953432-68c2-42c0-949f-a2887f2d97a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:49.776817 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-66953432-68c2-42c0-949f-a2887f2d97a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:49.777986 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-66953432-68c2-42c0-949f-a2887f2d97a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.195110 Dec 15 14:12:49.778642 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 511/1014] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:49 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:50.353587 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e554c68d-ebd5-436d-919c-4a1e9617121e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:50.354235 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e554c68d-ebd5-436d-919c-4a1e9617121e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:50.361005 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e554c68d-ebd5-436d-919c-4a1e9617121e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:50.361453 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e554c68d-ebd5-436d-919c-4a1e9617121e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:50.362259 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e554c68d-ebd5-436d-919c-4a1e9617121e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:50.362694 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e554c68d-ebd5-436d-919c-4a1e9617121e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:50.515534 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e554c68d-ebd5-436d-919c-4a1e9617121e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:50.524041 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e554c68d-ebd5-436d-919c-4a1e9617121e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.175435 Dec 15 14:12:50.524609 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 504/1015] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:50 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:50.796375 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-54e3b480-52b4-495d-ba88-87f61d2501b7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:50.796988 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-54e3b480-52b4-495d-ba88-87f61d2501b7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:50.804067 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54e3b480-52b4-495d-ba88-87f61d2501b7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:50.804537 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54e3b480-52b4-495d-ba88-87f61d2501b7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:50.805325 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54e3b480-52b4-495d-ba88-87f61d2501b7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:50.805798 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54e3b480-52b4-495d-ba88-87f61d2501b7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:50.947669 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-54e3b480-52b4-495d-ba88-87f61d2501b7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:50.956579 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-54e3b480-52b4-495d-ba88-87f61d2501b7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:50.958146 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-54e3b480-52b4-495d-ba88-87f61d2501b7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:50.959281 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-54e3b480-52b4-495d-ba88-87f61d2501b7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.166754 Dec 15 14:12:50.969975 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 512/1016] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:50 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:51.545561 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-61811057-7a88-4501-98a2-146a92fcee23 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:51.546491 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-61811057-7a88-4501-98a2-146a92fcee23 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:51.556724 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61811057-7a88-4501-98a2-146a92fcee23 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:51.557165 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61811057-7a88-4501-98a2-146a92fcee23 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:51.557967 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61811057-7a88-4501-98a2-146a92fcee23 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:51.558398 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61811057-7a88-4501-98a2-146a92fcee23 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:51.710181 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-61811057-7a88-4501-98a2-146a92fcee23 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:51.725086 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-61811057-7a88-4501-98a2-146a92fcee23 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.185605 Dec 15 14:12:51.726107 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 505/1017] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:51 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:51.981586 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-45364299-ec74-41c1-9f26-b2f486cfc94d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:51.982386 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-45364299-ec74-41c1-9f26-b2f486cfc94d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:51.991304 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-45364299-ec74-41c1-9f26-b2f486cfc94d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:51.991890 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-45364299-ec74-41c1-9f26-b2f486cfc94d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:51.993105 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-45364299-ec74-41c1-9f26-b2f486cfc94d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:51.993560 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-45364299-ec74-41c1-9f26-b2f486cfc94d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:52.130331 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-45364299-ec74-41c1-9f26-b2f486cfc94d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:52.140520 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-45364299-ec74-41c1-9f26-b2f486cfc94d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:52.142056 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-45364299-ec74-41c1-9f26-b2f486cfc94d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:52.143220 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-45364299-ec74-41c1-9f26-b2f486cfc94d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.167236 Dec 15 14:12:52.143784 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 513/1018] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:51 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:52.747022 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9aff0a38-bdc5-47a8-9d0c-271b56e406fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:52.747758 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9aff0a38-bdc5-47a8-9d0c-271b56e406fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:52.756110 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9aff0a38-bdc5-47a8-9d0c-271b56e406fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:52.756671 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9aff0a38-bdc5-47a8-9d0c-271b56e406fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:52.757649 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9aff0a38-bdc5-47a8-9d0c-271b56e406fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:52.758234 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9aff0a38-bdc5-47a8-9d0c-271b56e406fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:52.911959 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9aff0a38-bdc5-47a8-9d0c-271b56e406fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:52.919789 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9aff0a38-bdc5-47a8-9d0c-271b56e406fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.178138 Dec 15 14:12:52.920361 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 506/1019] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:52 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:53.165398 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6d3dc8d7-2859-4ce1-b6b1-0f904503ffe4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:53.166061 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6d3dc8d7-2859-4ce1-b6b1-0f904503ffe4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:53.173032 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d3dc8d7-2859-4ce1-b6b1-0f904503ffe4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:53.173492 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d3dc8d7-2859-4ce1-b6b1-0f904503ffe4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:53.174321 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d3dc8d7-2859-4ce1-b6b1-0f904503ffe4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:53.174765 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d3dc8d7-2859-4ce1-b6b1-0f904503ffe4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:53.316177 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6d3dc8d7-2859-4ce1-b6b1-0f904503ffe4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:53.325084 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6d3dc8d7-2859-4ce1-b6b1-0f904503ffe4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:53.326605 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6d3dc8d7-2859-4ce1-b6b1-0f904503ffe4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:53.327764 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6d3dc8d7-2859-4ce1-b6b1-0f904503ffe4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.168020 Dec 15 14:12:53.328315 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 514/1020] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:53 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:53.941570 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-71ba84db-1928-4cd1-aa14-96dd3df3a263 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:53.942604 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-71ba84db-1928-4cd1-aa14-96dd3df3a263 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:53.950994 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71ba84db-1928-4cd1-aa14-96dd3df3a263 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:53.951445 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71ba84db-1928-4cd1-aa14-96dd3df3a263 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:53.952242 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71ba84db-1928-4cd1-aa14-96dd3df3a263 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:53.952681 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71ba84db-1928-4cd1-aa14-96dd3df3a263 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:54.101122 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-71ba84db-1928-4cd1-aa14-96dd3df3a263 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:54.109712 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-71ba84db-1928-4cd1-aa14-96dd3df3a263 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.174680 Dec 15 14:12:54.110280 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 507/1021] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:53 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:54.347141 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2d2f38f5-40d4-4a72-9f22-b20788e0ede2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:54.347760 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2d2f38f5-40d4-4a72-9f22-b20788e0ede2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:54.354822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d2f38f5-40d4-4a72-9f22-b20788e0ede2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:54.355278 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d2f38f5-40d4-4a72-9f22-b20788e0ede2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:54.356100 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d2f38f5-40d4-4a72-9f22-b20788e0ede2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:54.356538 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d2f38f5-40d4-4a72-9f22-b20788e0ede2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:54.507816 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2d2f38f5-40d4-4a72-9f22-b20788e0ede2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:54.516379 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2d2f38f5-40d4-4a72-9f22-b20788e0ede2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:54.517956 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2d2f38f5-40d4-4a72-9f22-b20788e0ede2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:54.519149 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2d2f38f5-40d4-4a72-9f22-b20788e0ede2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.176233 Dec 15 14:12:54.519712 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 515/1022] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:54 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:55.128254 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-323afd7f-7f6c-4b91-839a-ad6be33c572d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:55.128858 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-323afd7f-7f6c-4b91-839a-ad6be33c572d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:55.137355 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-323afd7f-7f6c-4b91-839a-ad6be33c572d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:55.137899 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-323afd7f-7f6c-4b91-839a-ad6be33c572d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:55.138756 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-323afd7f-7f6c-4b91-839a-ad6be33c572d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:55.139252 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-323afd7f-7f6c-4b91-839a-ad6be33c572d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:55.281422 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-323afd7f-7f6c-4b91-839a-ad6be33c572d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:55.292944 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-323afd7f-7f6c-4b91-839a-ad6be33c572d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.169208 Dec 15 14:12:55.293740 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 508/1023] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:55 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:55.541141 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6dde4a73-8b13-4569-b400-037fd0729fc2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:55.541753 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6dde4a73-8b13-4569-b400-037fd0729fc2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:55.548387 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dde4a73-8b13-4569-b400-037fd0729fc2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:55.548839 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dde4a73-8b13-4569-b400-037fd0729fc2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:55.549648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dde4a73-8b13-4569-b400-037fd0729fc2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:55.550098 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dde4a73-8b13-4569-b400-037fd0729fc2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:55.697279 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6dde4a73-8b13-4569-b400-037fd0729fc2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:55.706564 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6dde4a73-8b13-4569-b400-037fd0729fc2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:55.708064 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6dde4a73-8b13-4569-b400-037fd0729fc2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:55.709228 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6dde4a73-8b13-4569-b400-037fd0729fc2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.173340 Dec 15 14:12:55.709823 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 516/1024] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:55 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:56.315021 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-16940ef4-f5bf-4704-bf17-022b6197ec0c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:56.315631 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-16940ef4-f5bf-4704-bf17-022b6197ec0c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:56.322245 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16940ef4-f5bf-4704-bf17-022b6197ec0c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:56.322692 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16940ef4-f5bf-4704-bf17-022b6197ec0c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:56.323523 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16940ef4-f5bf-4704-bf17-022b6197ec0c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:56.323954 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16940ef4-f5bf-4704-bf17-022b6197ec0c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:56.469843 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-16940ef4-f5bf-4704-bf17-022b6197ec0c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:56.481458 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-16940ef4-f5bf-4704-bf17-022b6197ec0c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.169792 Dec 15 14:12:56.482205 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 509/1025] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:56 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:56.731359 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ada2ac21-c699-484d-89c7-6fa48add963b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:56.732023 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ada2ac21-c699-484d-89c7-6fa48add963b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:56.742008 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ada2ac21-c699-484d-89c7-6fa48add963b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:56.742642 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ada2ac21-c699-484d-89c7-6fa48add963b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:56.743653 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ada2ac21-c699-484d-89c7-6fa48add963b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:56.744096 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ada2ac21-c699-484d-89c7-6fa48add963b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:56.892773 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ada2ac21-c699-484d-89c7-6fa48add963b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:56.901060 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ada2ac21-c699-484d-89c7-6fa48add963b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:56.902556 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ada2ac21-c699-484d-89c7-6fa48add963b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:56.903756 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ada2ac21-c699-484d-89c7-6fa48add963b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.178070 Dec 15 14:12:56.904312 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 517/1026] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:56 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:57.502476 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3d572826-0425-4d0e-b21f-987fe5511336 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:57.503407 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3d572826-0425-4d0e-b21f-987fe5511336 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:57.514546 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d572826-0425-4d0e-b21f-987fe5511336 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:57.515175 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d572826-0425-4d0e-b21f-987fe5511336 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:57.516350 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d572826-0425-4d0e-b21f-987fe5511336 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:57.516966 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d572826-0425-4d0e-b21f-987fe5511336 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:57.659135 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3d572826-0425-4d0e-b21f-987fe5511336 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:57.666967 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3d572826-0425-4d0e-b21f-987fe5511336 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.170732 Dec 15 14:12:57.667540 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 510/1027] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:57 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:57.926320 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c49b1633-cb82-4974-94ef-4a58cc9f1111 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:57.927344 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c49b1633-cb82-4974-94ef-4a58cc9f1111 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:57.941314 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c49b1633-cb82-4974-94ef-4a58cc9f1111 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:57.942131 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c49b1633-cb82-4974-94ef-4a58cc9f1111 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:57.943454 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c49b1633-cb82-4974-94ef-4a58cc9f1111 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:57.944185 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c49b1633-cb82-4974-94ef-4a58cc9f1111 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:58.096434 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c49b1633-cb82-4974-94ef-4a58cc9f1111 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:58.107783 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c49b1633-cb82-4974-94ef-4a58cc9f1111 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:58.109314 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c49b1633-cb82-4974-94ef-4a58cc9f1111 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:58.110532 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c49b1633-cb82-4974-94ef-4a58cc9f1111 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.190594 Dec 15 14:12:58.111098 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 518/1028] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:57 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:58.685091 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dafa0304-8e34-458c-9bbf-8cb65119aba7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:58.685752 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dafa0304-8e34-458c-9bbf-8cb65119aba7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:58.693249 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dafa0304-8e34-458c-9bbf-8cb65119aba7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:58.693828 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dafa0304-8e34-458c-9bbf-8cb65119aba7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:58.694682 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dafa0304-8e34-458c-9bbf-8cb65119aba7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:58.695168 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dafa0304-8e34-458c-9bbf-8cb65119aba7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:58.838404 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dafa0304-8e34-458c-9bbf-8cb65119aba7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:58.847244 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dafa0304-8e34-458c-9bbf-8cb65119aba7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.166529 Dec 15 14:12:58.847830 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 511/1029] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:58 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:12:59.133341 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bc2ab3ea-4997-4d9a-a45f-5afe831d70a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:59.134428 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bc2ab3ea-4997-4d9a-a45f-5afe831d70a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:59.141084 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc2ab3ea-4997-4d9a-a45f-5afe831d70a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:59.141532 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc2ab3ea-4997-4d9a-a45f-5afe831d70a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:59.142338 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc2ab3ea-4997-4d9a-a45f-5afe831d70a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:59.142766 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc2ab3ea-4997-4d9a-a45f-5afe831d70a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:59.280516 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bc2ab3ea-4997-4d9a-a45f-5afe831d70a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:59.288887 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bc2ab3ea-4997-4d9a-a45f-5afe831d70a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:59.290739 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bc2ab3ea-4997-4d9a-a45f-5afe831d70a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:12:59.291891 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bc2ab3ea-4997-4d9a-a45f-5afe831d70a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.164807 Dec 15 14:12:59.292451 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 519/1030] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:12:59 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:59.867978 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d0b54394-5313-45fd-ae00-3066d1a52bd6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:12:59.869599 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d0b54394-5313-45fd-ae00-3066d1a52bd6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:12:59.879688 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0b54394-5313-45fd-ae00-3066d1a52bd6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:59.880372 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0b54394-5313-45fd-ae00-3066d1a52bd6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:59.881566 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0b54394-5313-45fd-ae00-3066d1a52bd6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:59.882268 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0b54394-5313-45fd-ae00-3066d1a52bd6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:00.038015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d0b54394-5313-45fd-ae00-3066d1a52bd6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:00.047097 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d0b54394-5313-45fd-ae00-3066d1a52bd6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.184837 Dec 15 14:13:00.047703 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 512/1031] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:12:59 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:00.315497 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b6df211c-8d14-473b-af39-53b035115f59 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:00.316354 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b6df211c-8d14-473b-af39-53b035115f59 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:00.327309 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6df211c-8d14-473b-af39-53b035115f59 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:00.328117 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6df211c-8d14-473b-af39-53b035115f59 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:00.329426 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6df211c-8d14-473b-af39-53b035115f59 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:00.330222 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6df211c-8d14-473b-af39-53b035115f59 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:00.483441 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b6df211c-8d14-473b-af39-53b035115f59 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:00.492591 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b6df211c-8d14-473b-af39-53b035115f59 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:00.494144 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b6df211c-8d14-473b-af39-53b035115f59 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:00.495317 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b6df211c-8d14-473b-af39-53b035115f59 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.186440 Dec 15 14:13:00.495888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 520/1032] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:00 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:01.068659 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-761a62b2-968f-43ef-9dec-98e93ce4827f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:01.069712 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-761a62b2-968f-43ef-9dec-98e93ce4827f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:01.080640 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-761a62b2-968f-43ef-9dec-98e93ce4827f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:01.081434 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-761a62b2-968f-43ef-9dec-98e93ce4827f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:01.082784 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-761a62b2-968f-43ef-9dec-98e93ce4827f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:01.083546 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-761a62b2-968f-43ef-9dec-98e93ce4827f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:01.246581 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-761a62b2-968f-43ef-9dec-98e93ce4827f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:01.254635 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-761a62b2-968f-43ef-9dec-98e93ce4827f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.192266 Dec 15 14:13:01.255206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 513/1033] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:01 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:01.514855 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9f8fd890-b336-4574-8a8e-036a193339ea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:01.515545 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9f8fd890-b336-4574-8a8e-036a193339ea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:01.522390 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f8fd890-b336-4574-8a8e-036a193339ea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:01.522847 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f8fd890-b336-4574-8a8e-036a193339ea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:01.523636 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f8fd890-b336-4574-8a8e-036a193339ea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:01.524144 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f8fd890-b336-4574-8a8e-036a193339ea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:01.664093 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9f8fd890-b336-4574-8a8e-036a193339ea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:01.672934 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9f8fd890-b336-4574-8a8e-036a193339ea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:01.674475 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9f8fd890-b336-4574-8a8e-036a193339ea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:01.675643 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9f8fd890-b336-4574-8a8e-036a193339ea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.164968 Dec 15 14:13:01.676448 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 521/1034] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:01 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:02.274264 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3b5f5c2b-0792-4ccf-a1b4-87b22a94e5ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:02.275247 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3b5f5c2b-0792-4ccf-a1b4-87b22a94e5ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:02.284119 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b5f5c2b-0792-4ccf-a1b4-87b22a94e5ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:02.284739 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b5f5c2b-0792-4ccf-a1b4-87b22a94e5ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:02.285819 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b5f5c2b-0792-4ccf-a1b4-87b22a94e5ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:02.286403 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b5f5c2b-0792-4ccf-a1b4-87b22a94e5ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:02.433651 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3b5f5c2b-0792-4ccf-a1b4-87b22a94e5ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:02.441020 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3b5f5c2b-0792-4ccf-a1b4-87b22a94e5ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.171869 Dec 15 14:13:02.441564 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 514/1035] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:02 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:02.695031 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-81eaa3a3-7da9-4cf2-8fc3-2f4322bdbd88 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:02.695782 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-81eaa3a3-7da9-4cf2-8fc3-2f4322bdbd88 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:02.703088 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81eaa3a3-7da9-4cf2-8fc3-2f4322bdbd88 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:02.703567 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81eaa3a3-7da9-4cf2-8fc3-2f4322bdbd88 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:02.704426 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81eaa3a3-7da9-4cf2-8fc3-2f4322bdbd88 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:02.704861 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81eaa3a3-7da9-4cf2-8fc3-2f4322bdbd88 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:02.889240 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-81eaa3a3-7da9-4cf2-8fc3-2f4322bdbd88 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:02.906505 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-81eaa3a3-7da9-4cf2-8fc3-2f4322bdbd88 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:02.908005 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-81eaa3a3-7da9-4cf2-8fc3-2f4322bdbd88 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:02.909277 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-81eaa3a3-7da9-4cf2-8fc3-2f4322bdbd88 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.218041 Dec 15 14:13:02.910213 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 522/1036] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:02 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:03.462152 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-56ee8c13-cc49-4606-9d5a-d62dcaf684fc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:03.462786 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-56ee8c13-cc49-4606-9d5a-d62dcaf684fc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:03.470362 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-56ee8c13-cc49-4606-9d5a-d62dcaf684fc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:03.470803 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-56ee8c13-cc49-4606-9d5a-d62dcaf684fc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:03.471597 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-56ee8c13-cc49-4606-9d5a-d62dcaf684fc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:03.472139 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-56ee8c13-cc49-4606-9d5a-d62dcaf684fc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:03.634322 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-56ee8c13-cc49-4606-9d5a-d62dcaf684fc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:03.643834 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-56ee8c13-cc49-4606-9d5a-d62dcaf684fc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.186958 Dec 15 14:13:03.644695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 515/1037] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:03 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:03.935482 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-84c100bc-a1bb-48b7-ac27-ec7bd239b62e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:03.936393 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-84c100bc-a1bb-48b7-ac27-ec7bd239b62e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:03.947026 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84c100bc-a1bb-48b7-ac27-ec7bd239b62e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:03.947473 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84c100bc-a1bb-48b7-ac27-ec7bd239b62e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:03.948257 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84c100bc-a1bb-48b7-ac27-ec7bd239b62e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:03.948694 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84c100bc-a1bb-48b7-ac27-ec7bd239b62e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:04.104258 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-84c100bc-a1bb-48b7-ac27-ec7bd239b62e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:04.113163 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-84c100bc-a1bb-48b7-ac27-ec7bd239b62e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:04.114688 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-84c100bc-a1bb-48b7-ac27-ec7bd239b62e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:04.115818 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-84c100bc-a1bb-48b7-ac27-ec7bd239b62e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.186824 Dec 15 14:13:04.116380 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 523/1038] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:03 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:04.665634 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-42d0bd40-1111-4719-b55a-ef4cfa599167 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:04.666258 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-42d0bd40-1111-4719-b55a-ef4cfa599167 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:04.672851 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42d0bd40-1111-4719-b55a-ef4cfa599167 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:04.673105 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42d0bd40-1111-4719-b55a-ef4cfa599167 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:04.673929 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42d0bd40-1111-4719-b55a-ef4cfa599167 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:04.674356 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42d0bd40-1111-4719-b55a-ef4cfa599167 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:04.813712 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-42d0bd40-1111-4719-b55a-ef4cfa599167 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:04.821820 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-42d0bd40-1111-4719-b55a-ef4cfa599167 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.162153 Dec 15 14:13:04.822388 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 516/1039] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:04 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:05.134821 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-80aca304-c402-436b-8ce6-e4d02d604063 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:05.135542 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-80aca304-c402-436b-8ce6-e4d02d604063 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:05.142321 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80aca304-c402-436b-8ce6-e4d02d604063 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:05.142767 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80aca304-c402-436b-8ce6-e4d02d604063 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:05.143548 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80aca304-c402-436b-8ce6-e4d02d604063 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:05.143985 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80aca304-c402-436b-8ce6-e4d02d604063 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:05.291277 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-80aca304-c402-436b-8ce6-e4d02d604063 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:05.300494 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-80aca304-c402-436b-8ce6-e4d02d604063 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:05.302027 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-80aca304-c402-436b-8ce6-e4d02d604063 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:05.303193 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-80aca304-c402-436b-8ce6-e4d02d604063 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.172916 Dec 15 14:13:05.303758 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 524/1040] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:05 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:05.843250 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-460b2f1c-87f0-4304-8709-68f9b1827697 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:05.844179 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-460b2f1c-87f0-4304-8709-68f9b1827697 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:05.854441 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-460b2f1c-87f0-4304-8709-68f9b1827697 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:05.854886 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-460b2f1c-87f0-4304-8709-68f9b1827697 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:05.855676 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-460b2f1c-87f0-4304-8709-68f9b1827697 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:05.856106 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-460b2f1c-87f0-4304-8709-68f9b1827697 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:06.006065 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-460b2f1c-87f0-4304-8709-68f9b1827697 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:06.014249 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-460b2f1c-87f0-4304-8709-68f9b1827697 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.177392 Dec 15 14:13:06.014852 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 517/1041] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:05 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:06.325694 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-28b1e987-c902-4f29-ae78-b89fad90e1d9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:06.326327 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-28b1e987-c902-4f29-ae78-b89fad90e1d9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:06.335760 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28b1e987-c902-4f29-ae78-b89fad90e1d9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:06.336340 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28b1e987-c902-4f29-ae78-b89fad90e1d9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:06.337495 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28b1e987-c902-4f29-ae78-b89fad90e1d9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:06.337996 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28b1e987-c902-4f29-ae78-b89fad90e1d9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:06.483955 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-28b1e987-c902-4f29-ae78-b89fad90e1d9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:06.493572 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-28b1e987-c902-4f29-ae78-b89fad90e1d9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:06.495389 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-28b1e987-c902-4f29-ae78-b89fad90e1d9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:06.496577 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-28b1e987-c902-4f29-ae78-b89fad90e1d9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.176968 Dec 15 14:13:06.497135 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 525/1042] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:06 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:07.034556 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fa805d19-5e88-4cdf-8e55-12239a19b2ca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:07.035249 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fa805d19-5e88-4cdf-8e55-12239a19b2ca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:07.046491 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa805d19-5e88-4cdf-8e55-12239a19b2ca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:07.047366 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa805d19-5e88-4cdf-8e55-12239a19b2ca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:07.048688 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa805d19-5e88-4cdf-8e55-12239a19b2ca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:07.049428 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa805d19-5e88-4cdf-8e55-12239a19b2ca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:07.202539 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fa805d19-5e88-4cdf-8e55-12239a19b2ca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:07.213842 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fa805d19-5e88-4cdf-8e55-12239a19b2ca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.184912 Dec 15 14:13:07.214509 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 518/1043] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:07 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:07.517237 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-82b750a1-6b6c-4e70-930d-58539669a17a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:07.517996 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-82b750a1-6b6c-4e70-930d-58539669a17a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:07.526456 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-82b750a1-6b6c-4e70-930d-58539669a17a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:07.527238 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-82b750a1-6b6c-4e70-930d-58539669a17a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:07.528223 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-82b750a1-6b6c-4e70-930d-58539669a17a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:07.528774 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-82b750a1-6b6c-4e70-930d-58539669a17a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:07.669672 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-82b750a1-6b6c-4e70-930d-58539669a17a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:07.682987 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-82b750a1-6b6c-4e70-930d-58539669a17a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:07.685244 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-82b750a1-6b6c-4e70-930d-58539669a17a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:07.687174 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-82b750a1-6b6c-4e70-930d-58539669a17a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.174380 Dec 15 14:13:07.688094 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 526/1044] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:07 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:08.239834 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2855306c-4b42-40f4-b26c-2befb8b1e9a0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:08.241021 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2855306c-4b42-40f4-b26c-2befb8b1e9a0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:08.251997 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2855306c-4b42-40f4-b26c-2befb8b1e9a0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:08.252756 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2855306c-4b42-40f4-b26c-2befb8b1e9a0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:08.254102 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2855306c-4b42-40f4-b26c-2befb8b1e9a0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:08.254812 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2855306c-4b42-40f4-b26c-2befb8b1e9a0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:08.397559 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2855306c-4b42-40f4-b26c-2befb8b1e9a0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:08.406100 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2855306c-4b42-40f4-b26c-2befb8b1e9a0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.173069 Dec 15 14:13:08.406678 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 519/1045] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:08 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:08.709404 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ad12155e-12ff-4053-8a53-ab4cb89d1d16 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:08.710412 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ad12155e-12ff-4053-8a53-ab4cb89d1d16 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:08.718939 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad12155e-12ff-4053-8a53-ab4cb89d1d16 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:08.719393 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad12155e-12ff-4053-8a53-ab4cb89d1d16 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:08.720188 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad12155e-12ff-4053-8a53-ab4cb89d1d16 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:08.720627 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad12155e-12ff-4053-8a53-ab4cb89d1d16 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:08.871613 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ad12155e-12ff-4053-8a53-ab4cb89d1d16 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:08.884244 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ad12155e-12ff-4053-8a53-ab4cb89d1d16 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:08.885804 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ad12155e-12ff-4053-8a53-ab4cb89d1d16 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:08.887069 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ad12155e-12ff-4053-8a53-ab4cb89d1d16 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.183989 Dec 15 14:13:08.887676 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 527/1046] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:08 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:09.428382 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-654fd033-2de5-48ef-8393-8753478a2694 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:09.429441 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-654fd033-2de5-48ef-8393-8753478a2694 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:09.437219 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-654fd033-2de5-48ef-8393-8753478a2694 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:09.437682 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-654fd033-2de5-48ef-8393-8753478a2694 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:09.438506 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-654fd033-2de5-48ef-8393-8753478a2694 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:09.438942 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-654fd033-2de5-48ef-8393-8753478a2694 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:09.585584 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-654fd033-2de5-48ef-8393-8753478a2694 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:09.594279 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-654fd033-2de5-48ef-8393-8753478a2694 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.172966 Dec 15 14:13:09.594836 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 520/1047] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:09 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:09.906655 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d4db261b-6e37-47cd-bec6-e1cb3773e033 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:09.907261 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d4db261b-6e37-47cd-bec6-e1cb3773e033 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:09.914038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4db261b-6e37-47cd-bec6-e1cb3773e033 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:09.915159 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4db261b-6e37-47cd-bec6-e1cb3773e033 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:09.915678 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4db261b-6e37-47cd-bec6-e1cb3773e033 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:09.915902 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4db261b-6e37-47cd-bec6-e1cb3773e033 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:10.057453 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d4db261b-6e37-47cd-bec6-e1cb3773e033 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:10.066390 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d4db261b-6e37-47cd-bec6-e1cb3773e033 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:10.067972 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d4db261b-6e37-47cd-bec6-e1cb3773e033 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:10.069162 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d4db261b-6e37-47cd-bec6-e1cb3773e033 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.166428 Dec 15 14:13:10.069749 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 528/1048] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:09 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:10.615674 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-88ca9497-8609-4e13-b918-193378e48b37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:10.616342 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-88ca9497-8609-4e13-b918-193378e48b37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:10.623926 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-88ca9497-8609-4e13-b918-193378e48b37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:10.624416 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-88ca9497-8609-4e13-b918-193378e48b37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:10.625271 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-88ca9497-8609-4e13-b918-193378e48b37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:10.625776 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-88ca9497-8609-4e13-b918-193378e48b37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:10.772613 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-88ca9497-8609-4e13-b918-193378e48b37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:10.780974 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-88ca9497-8609-4e13-b918-193378e48b37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.169470 Dec 15 14:13:10.781595 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 521/1049] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:10 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:11.092735 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3d1e1cbd-d191-4a09-aa18-0d2b15f9874c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:11.093790 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3d1e1cbd-d191-4a09-aa18-0d2b15f9874c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:11.104669 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d1e1cbd-d191-4a09-aa18-0d2b15f9874c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:11.105132 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d1e1cbd-d191-4a09-aa18-0d2b15f9874c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:11.105950 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d1e1cbd-d191-4a09-aa18-0d2b15f9874c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:11.106395 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d1e1cbd-d191-4a09-aa18-0d2b15f9874c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:11.248348 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3d1e1cbd-d191-4a09-aa18-0d2b15f9874c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:11.260814 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3d1e1cbd-d191-4a09-aa18-0d2b15f9874c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:11.262382 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3d1e1cbd-d191-4a09-aa18-0d2b15f9874c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:11.263560 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3d1e1cbd-d191-4a09-aa18-0d2b15f9874c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.177822 Dec 15 14:13:11.264118 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 529/1050] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:11 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:11.799516 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8ec28737-d7b0-4080-a60a-82640f1ce16f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:11.800147 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8ec28737-d7b0-4080-a60a-82640f1ce16f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:11.807031 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ec28737-d7b0-4080-a60a-82640f1ce16f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:11.807484 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ec28737-d7b0-4080-a60a-82640f1ce16f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:11.808465 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ec28737-d7b0-4080-a60a-82640f1ce16f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:11.808919 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ec28737-d7b0-4080-a60a-82640f1ce16f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:11.951461 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8ec28737-d7b0-4080-a60a-82640f1ce16f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:11.964100 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8ec28737-d7b0-4080-a60a-82640f1ce16f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.167545 Dec 15 14:13:11.964845 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 522/1051] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:11 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:12.285318 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-adb4f120-6c51-4246-a513-16802447c7ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:12.286443 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-adb4f120-6c51-4246-a513-16802447c7ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:12.297438 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-adb4f120-6c51-4246-a513-16802447c7ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:12.298140 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-adb4f120-6c51-4246-a513-16802447c7ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:12.299431 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-adb4f120-6c51-4246-a513-16802447c7ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:12.300159 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-adb4f120-6c51-4246-a513-16802447c7ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:12.448567 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-adb4f120-6c51-4246-a513-16802447c7ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:12.462318 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-adb4f120-6c51-4246-a513-16802447c7ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:12.463981 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-adb4f120-6c51-4246-a513-16802447c7ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:12.465125 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-adb4f120-6c51-4246-a513-16802447c7ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.186055 Dec 15 14:13:12.465746 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 530/1052] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:12 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:12.990202 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6aafa53d-dcec-45b5-be8d-e714b5269e33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:12.991228 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6aafa53d-dcec-45b5-be8d-e714b5269e33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:12.999025 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6aafa53d-dcec-45b5-be8d-e714b5269e33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:12.999469 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6aafa53d-dcec-45b5-be8d-e714b5269e33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:13.000243 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6aafa53d-dcec-45b5-be8d-e714b5269e33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:13.000672 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6aafa53d-dcec-45b5-be8d-e714b5269e33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:13.145065 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6aafa53d-dcec-45b5-be8d-e714b5269e33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:13.152709 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6aafa53d-dcec-45b5-be8d-e714b5269e33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.168720 Dec 15 14:13:13.153430 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 523/1053] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:12 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:13.488011 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0b8423dc-805a-4fd8-ada4-f76a62da7a4a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:13.488864 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0b8423dc-805a-4fd8-ada4-f76a62da7a4a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:13.500919 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b8423dc-805a-4fd8-ada4-f76a62da7a4a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:13.501721 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b8423dc-805a-4fd8-ada4-f76a62da7a4a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:13.503039 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b8423dc-805a-4fd8-ada4-f76a62da7a4a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:13.503779 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b8423dc-805a-4fd8-ada4-f76a62da7a4a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:13.652239 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0b8423dc-805a-4fd8-ada4-f76a62da7a4a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:13.665120 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0b8423dc-805a-4fd8-ada4-f76a62da7a4a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:13.666916 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0b8423dc-805a-4fd8-ada4-f76a62da7a4a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:13.668083 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0b8423dc-805a-4fd8-ada4-f76a62da7a4a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.186490 Dec 15 14:13:13.668646 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 531/1054] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:13 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:14.169896 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a84e339a-11b1-449b-a387-8c0f89841fca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:14.170476 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a84e339a-11b1-449b-a387-8c0f89841fca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:14.177136 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a84e339a-11b1-449b-a387-8c0f89841fca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:14.177584 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a84e339a-11b1-449b-a387-8c0f89841fca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:14.178391 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a84e339a-11b1-449b-a387-8c0f89841fca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:14.178828 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a84e339a-11b1-449b-a387-8c0f89841fca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:14.317512 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a84e339a-11b1-449b-a387-8c0f89841fca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:14.325066 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a84e339a-11b1-449b-a387-8c0f89841fca tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.158928 Dec 15 14:13:14.325646 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 524/1055] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:14 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:14.689764 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-06c0a586-6c13-4bd1-a1cb-c3cf2fda1dcc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:14.690608 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-06c0a586-6c13-4bd1-a1cb-c3cf2fda1dcc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:14.700719 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06c0a586-6c13-4bd1-a1cb-c3cf2fda1dcc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:14.701351 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06c0a586-6c13-4bd1-a1cb-c3cf2fda1dcc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:14.702492 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06c0a586-6c13-4bd1-a1cb-c3cf2fda1dcc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:14.703104 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06c0a586-6c13-4bd1-a1cb-c3cf2fda1dcc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:14.860817 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-06c0a586-6c13-4bd1-a1cb-c3cf2fda1dcc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:14.872013 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-06c0a586-6c13-4bd1-a1cb-c3cf2fda1dcc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:14.873515 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-06c0a586-6c13-4bd1-a1cb-c3cf2fda1dcc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:14.874781 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-06c0a586-6c13-4bd1-a1cb-c3cf2fda1dcc tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.190432 Dec 15 14:13:14.875375 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 532/1056] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:14 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:15.344144 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b9c6338c-7d93-4058-ad1f-1a870a55b167 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:15.344841 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b9c6338c-7d93-4058-ad1f-1a870a55b167 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:15.351439 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9c6338c-7d93-4058-ad1f-1a870a55b167 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:15.351883 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9c6338c-7d93-4058-ad1f-1a870a55b167 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:15.352655 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9c6338c-7d93-4058-ad1f-1a870a55b167 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:15.353083 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9c6338c-7d93-4058-ad1f-1a870a55b167 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:15.503695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b9c6338c-7d93-4058-ad1f-1a870a55b167 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:15.512310 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b9c6338c-7d93-4058-ad1f-1a870a55b167 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.172438 Dec 15 14:13:15.512885 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 525/1057] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:15 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:15.897599 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0b0101f9-8dc5-4a84-a588-0278e5978391 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:15.898650 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0b0101f9-8dc5-4a84-a588-0278e5978391 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:15.910675 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b0101f9-8dc5-4a84-a588-0278e5978391 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:15.911424 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b0101f9-8dc5-4a84-a588-0278e5978391 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:15.912710 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b0101f9-8dc5-4a84-a588-0278e5978391 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:15.913434 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b0101f9-8dc5-4a84-a588-0278e5978391 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:16.053405 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0b0101f9-8dc5-4a84-a588-0278e5978391 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:16.063309 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0b0101f9-8dc5-4a84-a588-0278e5978391 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:16.064792 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0b0101f9-8dc5-4a84-a588-0278e5978391 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:16.066011 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0b0101f9-8dc5-4a84-a588-0278e5978391 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.174706 Dec 15 14:13:16.066554 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 533/1058] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:15 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:16.532682 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cc1f9ccd-17b8-4080-95dd-c8581fee00ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:16.533308 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cc1f9ccd-17b8-4080-95dd-c8581fee00ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:16.542967 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cc1f9ccd-17b8-4080-95dd-c8581fee00ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:16.543494 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cc1f9ccd-17b8-4080-95dd-c8581fee00ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:16.544281 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cc1f9ccd-17b8-4080-95dd-c8581fee00ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:16.544726 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cc1f9ccd-17b8-4080-95dd-c8581fee00ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:16.694584 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cc1f9ccd-17b8-4080-95dd-c8581fee00ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:16.706381 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cc1f9ccd-17b8-4080-95dd-c8581fee00ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.179139 Dec 15 14:13:16.707199 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 526/1059] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:16 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:17.089856 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4b113af0-7cb2-46e7-85f5-b9e41699103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:17.090862 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4b113af0-7cb2-46e7-85f5-b9e41699103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:17.102249 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b113af0-7cb2-46e7-85f5-b9e41699103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:17.103003 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b113af0-7cb2-46e7-85f5-b9e41699103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:17.104459 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b113af0-7cb2-46e7-85f5-b9e41699103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:17.104919 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b113af0-7cb2-46e7-85f5-b9e41699103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:17.258744 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4b113af0-7cb2-46e7-85f5-b9e41699103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:17.268475 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4b113af0-7cb2-46e7-85f5-b9e41699103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:17.269997 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4b113af0-7cb2-46e7-85f5-b9e41699103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:17.271167 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4b113af0-7cb2-46e7-85f5-b9e41699103e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.188204 Dec 15 14:13:17.271732 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 534/1060] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:17 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:17.730640 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-41f7aebf-0bcf-4541-a07b-6e7646a8bbd0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:17.731911 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-41f7aebf-0bcf-4541-a07b-6e7646a8bbd0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:17.742657 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41f7aebf-0bcf-4541-a07b-6e7646a8bbd0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:17.743400 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41f7aebf-0bcf-4541-a07b-6e7646a8bbd0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:17.744664 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41f7aebf-0bcf-4541-a07b-6e7646a8bbd0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:17.745387 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41f7aebf-0bcf-4541-a07b-6e7646a8bbd0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:17.893547 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-41f7aebf-0bcf-4541-a07b-6e7646a8bbd0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:17.905648 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-41f7aebf-0bcf-4541-a07b-6e7646a8bbd0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.180832 Dec 15 14:13:17.906430 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 527/1061] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:17 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:18.295168 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-238edadc-4c6d-49d0-8d15-e41136e55741 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:18.296095 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-238edadc-4c6d-49d0-8d15-e41136e55741 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:18.307317 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-238edadc-4c6d-49d0-8d15-e41136e55741 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:18.308244 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-238edadc-4c6d-49d0-8d15-e41136e55741 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:18.309429 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-238edadc-4c6d-49d0-8d15-e41136e55741 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:18.309891 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-238edadc-4c6d-49d0-8d15-e41136e55741 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:18.507860 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-238edadc-4c6d-49d0-8d15-e41136e55741 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:18.516990 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-238edadc-4c6d-49d0-8d15-e41136e55741 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:18.518527 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-238edadc-4c6d-49d0-8d15-e41136e55741 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:18.519694 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-238edadc-4c6d-49d0-8d15-e41136e55741 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.230929 Dec 15 14:13:18.529862 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 535/1062] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:18 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:18.931872 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-38b57c78-325c-4b07-88d2-61798ccb667b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:18.932820 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-38b57c78-325c-4b07-88d2-61798ccb667b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:18.940535 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38b57c78-325c-4b07-88d2-61798ccb667b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:18.940989 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38b57c78-325c-4b07-88d2-61798ccb667b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:18.941822 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38b57c78-325c-4b07-88d2-61798ccb667b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:18.942258 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38b57c78-325c-4b07-88d2-61798ccb667b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:19.099421 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-38b57c78-325c-4b07-88d2-61798ccb667b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:19.112589 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-38b57c78-325c-4b07-88d2-61798ccb667b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.186808 Dec 15 14:13:19.113504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 528/1063] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:18 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:19.539003 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f38a9543-97ba-411b-9aaf-a2a4a7fd7f04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:19.539638 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f38a9543-97ba-411b-9aaf-a2a4a7fd7f04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:19.546843 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f38a9543-97ba-411b-9aaf-a2a4a7fd7f04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:19.547616 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f38a9543-97ba-411b-9aaf-a2a4a7fd7f04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:19.548434 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f38a9543-97ba-411b-9aaf-a2a4a7fd7f04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:19.548860 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f38a9543-97ba-411b-9aaf-a2a4a7fd7f04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:19.712463 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f38a9543-97ba-411b-9aaf-a2a4a7fd7f04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:19.723659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f38a9543-97ba-411b-9aaf-a2a4a7fd7f04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:19.725155 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f38a9543-97ba-411b-9aaf-a2a4a7fd7f04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:19.726388 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f38a9543-97ba-411b-9aaf-a2a4a7fd7f04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.191373 Dec 15 14:13:19.726954 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 536/1064] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:19 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:20.138609 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9d0a04c5-33ed-4202-b999-7c5a331c5313 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:20.139217 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9d0a04c5-33ed-4202-b999-7c5a331c5313 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:20.146294 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d0a04c5-33ed-4202-b999-7c5a331c5313 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:20.146739 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d0a04c5-33ed-4202-b999-7c5a331c5313 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:20.147516 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d0a04c5-33ed-4202-b999-7c5a331c5313 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:20.147950 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d0a04c5-33ed-4202-b999-7c5a331c5313 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:20.366194 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9d0a04c5-33ed-4202-b999-7c5a331c5313 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:20.374435 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9d0a04c5-33ed-4202-b999-7c5a331c5313 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.243020 Dec 15 14:13:20.375020 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 529/1065] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:20 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:20.749515 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1a4be42e-1d9b-47a9-a66d-9caca45fb580 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:20.750410 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1a4be42e-1d9b-47a9-a66d-9caca45fb580 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:20.761534 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a4be42e-1d9b-47a9-a66d-9caca45fb580 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:20.762329 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a4be42e-1d9b-47a9-a66d-9caca45fb580 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:20.763447 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a4be42e-1d9b-47a9-a66d-9caca45fb580 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:20.763883 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a4be42e-1d9b-47a9-a66d-9caca45fb580 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:20.913579 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1a4be42e-1d9b-47a9-a66d-9caca45fb580 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:20.922568 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1a4be42e-1d9b-47a9-a66d-9caca45fb580 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:20.924062 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1a4be42e-1d9b-47a9-a66d-9caca45fb580 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:20.925227 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1a4be42e-1d9b-47a9-a66d-9caca45fb580 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.182108 Dec 15 14:13:20.925820 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 537/1066] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:20 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:21.395987 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8a748a6e-df03-423f-b256-88b2d877f487 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:21.396919 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8a748a6e-df03-423f-b256-88b2d877f487 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:21.406683 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a748a6e-df03-423f-b256-88b2d877f487 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:21.407139 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a748a6e-df03-423f-b256-88b2d877f487 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:21.407943 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a748a6e-df03-423f-b256-88b2d877f487 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:21.408380 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a748a6e-df03-423f-b256-88b2d877f487 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:21.710697 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8a748a6e-df03-423f-b256-88b2d877f487 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:21.718898 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8a748a6e-df03-423f-b256-88b2d877f487 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.329132 Dec 15 14:13:21.719472 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 530/1067] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:21 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:21.948367 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c7c9a49b-bfcd-43f7-8df8-fedc903876f2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:21.949293 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c7c9a49b-bfcd-43f7-8df8-fedc903876f2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:21.960688 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7c9a49b-bfcd-43f7-8df8-fedc903876f2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:21.961395 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7c9a49b-bfcd-43f7-8df8-fedc903876f2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:21.962756 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7c9a49b-bfcd-43f7-8df8-fedc903876f2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:21.963529 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7c9a49b-bfcd-43f7-8df8-fedc903876f2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:22.116441 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c7c9a49b-bfcd-43f7-8df8-fedc903876f2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:22.125168 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c7c9a49b-bfcd-43f7-8df8-fedc903876f2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:22.126694 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c7c9a49b-bfcd-43f7-8df8-fedc903876f2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:22.127849 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c7c9a49b-bfcd-43f7-8df8-fedc903876f2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.186028 Dec 15 14:13:22.128397 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 538/1068] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:21 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:22.740744 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d17186ea-a87b-4de9-a045-fd49d275c9fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:22.741350 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d17186ea-a87b-4de9-a045-fd49d275c9fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:22.748610 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d17186ea-a87b-4de9-a045-fd49d275c9fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:22.749146 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d17186ea-a87b-4de9-a045-fd49d275c9fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:22.750039 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d17186ea-a87b-4de9-a045-fd49d275c9fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:22.750477 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d17186ea-a87b-4de9-a045-fd49d275c9fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:22.888956 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d17186ea-a87b-4de9-a045-fd49d275c9fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:22.897008 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d17186ea-a87b-4de9-a045-fd49d275c9fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.159953 Dec 15 14:13:22.897570 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 531/1069] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:22 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:23.147786 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-169c0ab7-1fe3-4774-a628-dd0c6772fc82 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:23.148532 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-169c0ab7-1fe3-4774-a628-dd0c6772fc82 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:23.158024 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-169c0ab7-1fe3-4774-a628-dd0c6772fc82 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:23.158625 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-169c0ab7-1fe3-4774-a628-dd0c6772fc82 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:23.159663 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-169c0ab7-1fe3-4774-a628-dd0c6772fc82 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:23.160249 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-169c0ab7-1fe3-4774-a628-dd0c6772fc82 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:23.305838 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-169c0ab7-1fe3-4774-a628-dd0c6772fc82 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:23.319311 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-169c0ab7-1fe3-4774-a628-dd0c6772fc82 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:23.321676 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-169c0ab7-1fe3-4774-a628-dd0c6772fc82 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:23.323461 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-169c0ab7-1fe3-4774-a628-dd0c6772fc82 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.180650 Dec 15 14:13:23.324271 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 539/1070] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:23 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:23.916285 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-60c2f6e4-0b0c-49c2-bb88-8808178a8471 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:23.917003 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-60c2f6e4-0b0c-49c2-bb88-8808178a8471 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:23.924653 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60c2f6e4-0b0c-49c2-bb88-8808178a8471 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:23.925108 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60c2f6e4-0b0c-49c2-bb88-8808178a8471 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:23.925929 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60c2f6e4-0b0c-49c2-bb88-8808178a8471 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:23.926375 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60c2f6e4-0b0c-49c2-bb88-8808178a8471 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:24.069994 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-60c2f6e4-0b0c-49c2-bb88-8808178a8471 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:24.078154 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-60c2f6e4-0b0c-49c2-bb88-8808178a8471 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.167053 Dec 15 14:13:24.078741 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 532/1071] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:23 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:24.345970 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-297a834c-53ae-48f6-88c7-3257631dc28b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:24.346597 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-297a834c-53ae-48f6-88c7-3257631dc28b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:24.353876 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-297a834c-53ae-48f6-88c7-3257631dc28b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:24.354350 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-297a834c-53ae-48f6-88c7-3257631dc28b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:24.355260 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-297a834c-53ae-48f6-88c7-3257631dc28b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:24.355744 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-297a834c-53ae-48f6-88c7-3257631dc28b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:24.504376 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-297a834c-53ae-48f6-88c7-3257631dc28b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:24.515534 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-297a834c-53ae-48f6-88c7-3257631dc28b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:24.517121 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-297a834c-53ae-48f6-88c7-3257631dc28b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:24.519029 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-297a834c-53ae-48f6-88c7-3257631dc28b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.178476 Dec 15 14:13:24.519750 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 540/1072] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:24 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:25.096207 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a95c67d5-548c-45ee-bd88-354df3e2e494 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:25.096895 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a95c67d5-548c-45ee-bd88-354df3e2e494 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:25.103693 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a95c67d5-548c-45ee-bd88-354df3e2e494 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:25.104143 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a95c67d5-548c-45ee-bd88-354df3e2e494 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:25.104939 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a95c67d5-548c-45ee-bd88-354df3e2e494 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:25.105376 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a95c67d5-548c-45ee-bd88-354df3e2e494 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:25.249488 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a95c67d5-548c-45ee-bd88-354df3e2e494 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:25.260727 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a95c67d5-548c-45ee-bd88-354df3e2e494 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.168391 Dec 15 14:13:25.261522 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 533/1073] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:25 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:25.542991 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0002f22a-85d5-4758-a669-3e7833959593 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:25.543580 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0002f22a-85d5-4758-a669-3e7833959593 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:25.550934 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0002f22a-85d5-4758-a669-3e7833959593 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:25.551378 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0002f22a-85d5-4758-a669-3e7833959593 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:25.552191 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0002f22a-85d5-4758-a669-3e7833959593 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:25.552629 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0002f22a-85d5-4758-a669-3e7833959593 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:25.697898 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0002f22a-85d5-4758-a669-3e7833959593 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:25.710868 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0002f22a-85d5-4758-a669-3e7833959593 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:25.713024 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0002f22a-85d5-4758-a669-3e7833959593 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:25.714847 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0002f22a-85d5-4758-a669-3e7833959593 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.175560 Dec 15 14:13:25.715707 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 541/1074] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:25 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:26.283863 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-03e5829f-6095-4ebe-a37e-d4da70e336da tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:26.284794 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-03e5829f-6095-4ebe-a37e-d4da70e336da tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:26.295664 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03e5829f-6095-4ebe-a37e-d4da70e336da tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:26.296115 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03e5829f-6095-4ebe-a37e-d4da70e336da tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:26.296907 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03e5829f-6095-4ebe-a37e-d4da70e336da tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:26.297341 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03e5829f-6095-4ebe-a37e-d4da70e336da tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:26.446795 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-03e5829f-6095-4ebe-a37e-d4da70e336da tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:26.458759 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-03e5829f-6095-4ebe-a37e-d4da70e336da tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.181571 Dec 15 14:13:26.459530 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 534/1075] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:26 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:26.736909 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0b29b42f-30f2-4af7-93a4-ab006f64cb85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:26.737649 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0b29b42f-30f2-4af7-93a4-ab006f64cb85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:26.746613 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b29b42f-30f2-4af7-93a4-ab006f64cb85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:26.747175 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b29b42f-30f2-4af7-93a4-ab006f64cb85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:26.748333 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b29b42f-30f2-4af7-93a4-ab006f64cb85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:26.748886 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b29b42f-30f2-4af7-93a4-ab006f64cb85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:26.897525 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0b29b42f-30f2-4af7-93a4-ab006f64cb85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:26.906434 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0b29b42f-30f2-4af7-93a4-ab006f64cb85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:26.907903 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0b29b42f-30f2-4af7-93a4-ab006f64cb85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:26.909058 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0b29b42f-30f2-4af7-93a4-ab006f64cb85 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.177314 Dec 15 14:13:26.909634 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 542/1076] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:26 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:27.476697 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-73a7b2ca-5571-40de-9828-17548ea723fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:27.477313 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-73a7b2ca-5571-40de-9828-17548ea723fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:27.483979 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-73a7b2ca-5571-40de-9828-17548ea723fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:27.484433 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-73a7b2ca-5571-40de-9828-17548ea723fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:27.485230 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-73a7b2ca-5571-40de-9828-17548ea723fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:27.485744 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-73a7b2ca-5571-40de-9828-17548ea723fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:27.680482 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-73a7b2ca-5571-40de-9828-17548ea723fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:27.688855 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-73a7b2ca-5571-40de-9828-17548ea723fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.215866 Dec 15 14:13:27.689416 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 535/1077] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:27 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:28.070240 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0b3b1792-a78c-4197-b688-9332d045f1db tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:28.070828 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0b3b1792-a78c-4197-b688-9332d045f1db tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:28.077289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b3b1792-a78c-4197-b688-9332d045f1db tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:28.077950 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b3b1792-a78c-4197-b688-9332d045f1db tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:28.078750 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b3b1792-a78c-4197-b688-9332d045f1db tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:28.079197 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b3b1792-a78c-4197-b688-9332d045f1db tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:28.231923 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0b3b1792-a78c-4197-b688-9332d045f1db tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:28.241799 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0b3b1792-a78c-4197-b688-9332d045f1db tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:28.243341 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0b3b1792-a78c-4197-b688-9332d045f1db tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:28.244555 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0b3b1792-a78c-4197-b688-9332d045f1db tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.320344 Dec 15 14:13:28.245122 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 543/1078] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:27 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:28.710660 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b0e576f7-2a96-4f38-954b-9278a1578baf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:28.711680 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b0e576f7-2a96-4f38-954b-9278a1578baf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:28.721049 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0e576f7-2a96-4f38-954b-9278a1578baf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:28.721497 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0e576f7-2a96-4f38-954b-9278a1578baf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:28.722327 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0e576f7-2a96-4f38-954b-9278a1578baf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:28.722757 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0e576f7-2a96-4f38-954b-9278a1578baf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:28.876292 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b0e576f7-2a96-4f38-954b-9278a1578baf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:28.884218 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b0e576f7-2a96-4f38-954b-9278a1578baf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.179915 Dec 15 14:13:28.884792 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 536/1079] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:28 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:29.015016 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:13:29.015211 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:13:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:13:29.266759 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4bfde67a-e571-4612-842f-3a9d7e3b1343 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:29.267332 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4bfde67a-e571-4612-842f-3a9d7e3b1343 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:29.274356 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4bfde67a-e571-4612-842f-3a9d7e3b1343 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:29.274843 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4bfde67a-e571-4612-842f-3a9d7e3b1343 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:29.275697 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4bfde67a-e571-4612-842f-3a9d7e3b1343 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:29.276179 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4bfde67a-e571-4612-842f-3a9d7e3b1343 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:29.423139 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4bfde67a-e571-4612-842f-3a9d7e3b1343 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:29.426898 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:13:29.427128 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:13:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da (ip 10.222.0.42) !!! Dec 15 14:13:29.442330 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4bfde67a-e571-4612-842f-3a9d7e3b1343 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:29.444482 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4bfde67a-e571-4612-842f-3a9d7e3b1343 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:29.445644 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4bfde67a-e571-4612-842f-3a9d7e3b1343 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.184852 Dec 15 14:13:29.446243 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 544/1080] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:29 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:29.904608 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-69ca7a8f-fb4a-419f-b0a4-51608afe14b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:29.905428 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-69ca7a8f-fb4a-419f-b0a4-51608afe14b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:29.914866 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-69ca7a8f-fb4a-419f-b0a4-51608afe14b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:29.915508 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-69ca7a8f-fb4a-419f-b0a4-51608afe14b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:29.916625 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-69ca7a8f-fb4a-419f-b0a4-51608afe14b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:29.917263 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-69ca7a8f-fb4a-419f-b0a4-51608afe14b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:30.062334 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-69ca7a8f-fb4a-419f-b0a4-51608afe14b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:30.072199 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-69ca7a8f-fb4a-419f-b0a4-51608afe14b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.173113 Dec 15 14:13:30.081189 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 537/1081] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:29 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:30.469059 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c6dc0b75-ac8e-461c-9dfc-5ab1f42e9ad8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:30.470088 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c6dc0b75-ac8e-461c-9dfc-5ab1f42e9ad8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:30.480736 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6dc0b75-ac8e-461c-9dfc-5ab1f42e9ad8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:30.481524 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6dc0b75-ac8e-461c-9dfc-5ab1f42e9ad8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:30.482863 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6dc0b75-ac8e-461c-9dfc-5ab1f42e9ad8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:30.483896 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6dc0b75-ac8e-461c-9dfc-5ab1f42e9ad8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:30.625681 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c6dc0b75-ac8e-461c-9dfc-5ab1f42e9ad8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:30.634668 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c6dc0b75-ac8e-461c-9dfc-5ab1f42e9ad8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:30.636435 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c6dc0b75-ac8e-461c-9dfc-5ab1f42e9ad8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:30.637803 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c6dc0b75-ac8e-461c-9dfc-5ab1f42e9ad8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.175908 Dec 15 14:13:30.638743 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 545/1082] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:30 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:31.012885 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:13:31.013071 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:13:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:13:31.104849 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fd711daa-6380-487a-8f92-487c2532ec4c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:31.105636 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fd711daa-6380-487a-8f92-487c2532ec4c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:31.115708 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd711daa-6380-487a-8f92-487c2532ec4c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:31.116340 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd711daa-6380-487a-8f92-487c2532ec4c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:31.117427 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd711daa-6380-487a-8f92-487c2532ec4c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:31.118091 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd711daa-6380-487a-8f92-487c2532ec4c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:31.269988 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fd711daa-6380-487a-8f92-487c2532ec4c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:31.277742 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fd711daa-6380-487a-8f92-487c2532ec4c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.178455 Dec 15 14:13:31.278315 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 538/1083] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:31 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:31.659346 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4c4453ff-0e14-4d42-b3d8-1b84bfb0c645 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:31.660051 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4c4453ff-0e14-4d42-b3d8-1b84bfb0c645 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:31.667802 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4c4453ff-0e14-4d42-b3d8-1b84bfb0c645 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:31.668300 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4c4453ff-0e14-4d42-b3d8-1b84bfb0c645 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:31.669160 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4c4453ff-0e14-4d42-b3d8-1b84bfb0c645 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:31.669650 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4c4453ff-0e14-4d42-b3d8-1b84bfb0c645 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:31.820879 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4c4453ff-0e14-4d42-b3d8-1b84bfb0c645 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:31.830285 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4c4453ff-0e14-4d42-b3d8-1b84bfb0c645 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:31.831782 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4c4453ff-0e14-4d42-b3d8-1b84bfb0c645 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:31.832948 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4c4453ff-0e14-4d42-b3d8-1b84bfb0c645 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.179211 Dec 15 14:13:31.833484 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 546/1084] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:31 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:32.294845 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4d664a1e-2ae4-473f-9472-ff5f8da00c6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:32.295497 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4d664a1e-2ae4-473f-9472-ff5f8da00c6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:32.302332 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4d664a1e-2ae4-473f-9472-ff5f8da00c6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:32.302773 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4d664a1e-2ae4-473f-9472-ff5f8da00c6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:32.303597 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4d664a1e-2ae4-473f-9472-ff5f8da00c6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:32.304023 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4d664a1e-2ae4-473f-9472-ff5f8da00c6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:32.451597 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4d664a1e-2ae4-473f-9472-ff5f8da00c6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:32.460334 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4d664a1e-2ae4-473f-9472-ff5f8da00c6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.169161 Dec 15 14:13:32.460929 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 539/1085] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:32 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:32.852754 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fefba3dd-b777-4ff9-a30f-09fd65b04f1f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:32.853344 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fefba3dd-b777-4ff9-a30f-09fd65b04f1f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:32.861146 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fefba3dd-b777-4ff9-a30f-09fd65b04f1f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:32.861624 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fefba3dd-b777-4ff9-a30f-09fd65b04f1f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:32.862425 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fefba3dd-b777-4ff9-a30f-09fd65b04f1f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:32.862863 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fefba3dd-b777-4ff9-a30f-09fd65b04f1f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:33.012869 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fefba3dd-b777-4ff9-a30f-09fd65b04f1f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:33.022380 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fefba3dd-b777-4ff9-a30f-09fd65b04f1f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:33.023884 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fefba3dd-b777-4ff9-a30f-09fd65b04f1f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:33.025060 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fefba3dd-b777-4ff9-a30f-09fd65b04f1f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.176432 Dec 15 14:13:33.025648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 547/1086] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:32 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:33.482208 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b8b0d816-85b4-492f-97b2-7222e612aaf5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:33.483407 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b8b0d816-85b4-492f-97b2-7222e612aaf5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:33.490354 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8b0d816-85b4-492f-97b2-7222e612aaf5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:33.490798 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8b0d816-85b4-492f-97b2-7222e612aaf5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:33.491564 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8b0d816-85b4-492f-97b2-7222e612aaf5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:33.491997 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8b0d816-85b4-492f-97b2-7222e612aaf5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:33.635321 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b8b0d816-85b4-492f-97b2-7222e612aaf5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:33.645476 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b8b0d816-85b4-492f-97b2-7222e612aaf5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.169669 Dec 15 14:13:33.646106 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 540/1087] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:33 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:34.048066 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-86d3d989-8bb3-4587-bfb7-0e077e844c12 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:34.048937 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-86d3d989-8bb3-4587-bfb7-0e077e844c12 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:34.061047 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86d3d989-8bb3-4587-bfb7-0e077e844c12 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:34.062059 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86d3d989-8bb3-4587-bfb7-0e077e844c12 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:34.062984 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86d3d989-8bb3-4587-bfb7-0e077e844c12 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:34.063422 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86d3d989-8bb3-4587-bfb7-0e077e844c12 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:34.218274 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-86d3d989-8bb3-4587-bfb7-0e077e844c12 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:34.226859 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-86d3d989-8bb3-4587-bfb7-0e077e844c12 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:34.228350 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-86d3d989-8bb3-4587-bfb7-0e077e844c12 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:34.229766 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-86d3d989-8bb3-4587-bfb7-0e077e844c12 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.188317 Dec 15 14:13:34.230367 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 548/1088] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:34 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:34.663202 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a1b99b78-c34e-463f-b34b-2b491c0fd75d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:34.663827 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a1b99b78-c34e-463f-b34b-2b491c0fd75d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:34.670575 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a1b99b78-c34e-463f-b34b-2b491c0fd75d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:34.671036 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a1b99b78-c34e-463f-b34b-2b491c0fd75d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:34.671931 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a1b99b78-c34e-463f-b34b-2b491c0fd75d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:34.672262 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a1b99b78-c34e-463f-b34b-2b491c0fd75d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:34.817785 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a1b99b78-c34e-463f-b34b-2b491c0fd75d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:34.828252 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a1b99b78-c34e-463f-b34b-2b491c0fd75d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.168905 Dec 15 14:13:34.828995 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 541/1089] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:34 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:35.248358 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c6944302-31a6-4e3f-a6cd-63de72a5988d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:35.248972 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c6944302-31a6-4e3f-a6cd-63de72a5988d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:35.255884 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6944302-31a6-4e3f-a6cd-63de72a5988d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:35.256261 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6944302-31a6-4e3f-a6cd-63de72a5988d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:35.257036 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6944302-31a6-4e3f-a6cd-63de72a5988d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:35.257469 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6944302-31a6-4e3f-a6cd-63de72a5988d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:35.401090 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c6944302-31a6-4e3f-a6cd-63de72a5988d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:35.410303 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c6944302-31a6-4e3f-a6cd-63de72a5988d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:35.411802 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c6944302-31a6-4e3f-a6cd-63de72a5988d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:35.413003 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c6944302-31a6-4e3f-a6cd-63de72a5988d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.168445 Dec 15 14:13:35.413556 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 549/1090] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:35 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:35.846247 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e5e37336-1079-42a5-be43-4555fbb36b61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:35.846819 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e5e37336-1079-42a5-be43-4555fbb36b61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:35.853797 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e5e37336-1079-42a5-be43-4555fbb36b61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:35.854253 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e5e37336-1079-42a5-be43-4555fbb36b61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:35.855023 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e5e37336-1079-42a5-be43-4555fbb36b61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:35.855464 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e5e37336-1079-42a5-be43-4555fbb36b61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:36.003201 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e5e37336-1079-42a5-be43-4555fbb36b61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:36.011518 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e5e37336-1079-42a5-be43-4555fbb36b61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.169043 Dec 15 14:13:36.012086 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 542/1091] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:35 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:36.431464 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8b36729f-db8f-4920-9db7-3e351398ddb7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:36.432101 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8b36729f-db8f-4920-9db7-3e351398ddb7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:36.438903 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8b36729f-db8f-4920-9db7-3e351398ddb7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:36.440137 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8b36729f-db8f-4920-9db7-3e351398ddb7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:36.440137 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8b36729f-db8f-4920-9db7-3e351398ddb7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:36.440605 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8b36729f-db8f-4920-9db7-3e351398ddb7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:36.578486 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8b36729f-db8f-4920-9db7-3e351398ddb7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:36.590531 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8b36729f-db8f-4920-9db7-3e351398ddb7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:36.592400 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8b36729f-db8f-4920-9db7-3e351398ddb7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:36.593642 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8b36729f-db8f-4920-9db7-3e351398ddb7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.166020 Dec 15 14:13:36.594214 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 550/1092] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:36 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:37.033130 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-20f3a696-76c6-4995-b60c-2bc061e1e808 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:37.033830 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-20f3a696-76c6-4995-b60c-2bc061e1e808 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:37.040652 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20f3a696-76c6-4995-b60c-2bc061e1e808 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:37.041128 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20f3a696-76c6-4995-b60c-2bc061e1e808 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:37.041928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20f3a696-76c6-4995-b60c-2bc061e1e808 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:37.042389 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20f3a696-76c6-4995-b60c-2bc061e1e808 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:37.186696 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-20f3a696-76c6-4995-b60c-2bc061e1e808 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:37.199466 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-20f3a696-76c6-4995-b60c-2bc061e1e808 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.172811 Dec 15 14:13:37.200270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 543/1093] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:37 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:37.614877 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-adf4bd60-6d2b-47be-a634-5581c293b233 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:37.615644 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-adf4bd60-6d2b-47be-a634-5581c293b233 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:37.624370 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-adf4bd60-6d2b-47be-a634-5581c293b233 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:37.624969 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-adf4bd60-6d2b-47be-a634-5581c293b233 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:37.626051 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-adf4bd60-6d2b-47be-a634-5581c293b233 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:37.626862 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-adf4bd60-6d2b-47be-a634-5581c293b233 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:37.775362 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-adf4bd60-6d2b-47be-a634-5581c293b233 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:37.783943 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-adf4bd60-6d2b-47be-a634-5581c293b233 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:37.785517 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-adf4bd60-6d2b-47be-a634-5581c293b233 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:37.786716 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-adf4bd60-6d2b-47be-a634-5581c293b233 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.177543 Dec 15 14:13:37.787280 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 551/1094] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:37 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:38.220341 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a958ee4b-b4f7-4ba9-95ee-b5d81de05369 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:38.220915 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a958ee4b-b4f7-4ba9-95ee-b5d81de05369 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:38.228420 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a958ee4b-b4f7-4ba9-95ee-b5d81de05369 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:38.228877 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a958ee4b-b4f7-4ba9-95ee-b5d81de05369 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:38.229640 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a958ee4b-b4f7-4ba9-95ee-b5d81de05369 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:38.230102 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a958ee4b-b4f7-4ba9-95ee-b5d81de05369 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:38.385665 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a958ee4b-b4f7-4ba9-95ee-b5d81de05369 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:38.394720 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a958ee4b-b4f7-4ba9-95ee-b5d81de05369 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.178657 Dec 15 14:13:38.395295 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 544/1095] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:38 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:38.804856 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a5bb3294-a289-49d8-b7e2-2f4fbab5fedb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:38.805509 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a5bb3294-a289-49d8-b7e2-2f4fbab5fedb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:38.812651 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5bb3294-a289-49d8-b7e2-2f4fbab5fedb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:38.813111 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5bb3294-a289-49d8-b7e2-2f4fbab5fedb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:38.814142 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5bb3294-a289-49d8-b7e2-2f4fbab5fedb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:38.814610 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5bb3294-a289-49d8-b7e2-2f4fbab5fedb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:38.950952 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a5bb3294-a289-49d8-b7e2-2f4fbab5fedb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:38.960159 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a5bb3294-a289-49d8-b7e2-2f4fbab5fedb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:38.961648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a5bb3294-a289-49d8-b7e2-2f4fbab5fedb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:38.962876 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a5bb3294-a289-49d8-b7e2-2f4fbab5fedb tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.161845 Dec 15 14:13:38.963553 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 552/1096] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:38 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:39.415342 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-82246caa-9ccc-434f-9c9d-752addef04ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:39.416176 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-82246caa-9ccc-434f-9c9d-752addef04ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:39.425994 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-82246caa-9ccc-434f-9c9d-752addef04ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:39.426434 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-82246caa-9ccc-434f-9c9d-752addef04ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:39.427237 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-82246caa-9ccc-434f-9c9d-752addef04ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:39.427674 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-82246caa-9ccc-434f-9c9d-752addef04ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:39.564797 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-82246caa-9ccc-434f-9c9d-752addef04ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:39.574013 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-82246caa-9ccc-434f-9c9d-752addef04ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.164555 Dec 15 14:13:39.574549 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 545/1097] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:39 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:39.986055 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ddcb5d92-d694-4f29-adf1-f74962b68081 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:39.987312 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ddcb5d92-d694-4f29-adf1-f74962b68081 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:39.998121 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ddcb5d92-d694-4f29-adf1-f74962b68081 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:39.998874 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ddcb5d92-d694-4f29-adf1-f74962b68081 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:40.000257 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ddcb5d92-d694-4f29-adf1-f74962b68081 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:40.000992 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ddcb5d92-d694-4f29-adf1-f74962b68081 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:40.145290 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ddcb5d92-d694-4f29-adf1-f74962b68081 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:40.154563 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ddcb5d92-d694-4f29-adf1-f74962b68081 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:40.156092 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ddcb5d92-d694-4f29-adf1-f74962b68081 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:40.157252 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ddcb5d92-d694-4f29-adf1-f74962b68081 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.177634 Dec 15 14:13:40.157810 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 553/1098] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:39 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:40.597262 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-95563a91-d51e-48b9-ae0e-109ba381c527 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:40.597969 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-95563a91-d51e-48b9-ae0e-109ba381c527 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:40.604725 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-95563a91-d51e-48b9-ae0e-109ba381c527 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:40.605188 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-95563a91-d51e-48b9-ae0e-109ba381c527 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:40.606088 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-95563a91-d51e-48b9-ae0e-109ba381c527 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:40.606524 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-95563a91-d51e-48b9-ae0e-109ba381c527 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:40.745887 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-95563a91-d51e-48b9-ae0e-109ba381c527 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:40.755873 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-95563a91-d51e-48b9-ae0e-109ba381c527 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.164883 Dec 15 14:13:40.756443 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 546/1099] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:40 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:41.186982 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5e002cfc-5e7c-44dc-853a-8d9a12c73516 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:41.187705 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5e002cfc-5e7c-44dc-853a-8d9a12c73516 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:41.198439 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e002cfc-5e7c-44dc-853a-8d9a12c73516 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:41.199120 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e002cfc-5e7c-44dc-853a-8d9a12c73516 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:41.200369 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e002cfc-5e7c-44dc-853a-8d9a12c73516 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:41.201040 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e002cfc-5e7c-44dc-853a-8d9a12c73516 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:41.348122 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5e002cfc-5e7c-44dc-853a-8d9a12c73516 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:41.356736 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5e002cfc-5e7c-44dc-853a-8d9a12c73516 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:41.358281 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5e002cfc-5e7c-44dc-853a-8d9a12c73516 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:41.359450 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5e002cfc-5e7c-44dc-853a-8d9a12c73516 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.178762 Dec 15 14:13:41.360018 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 554/1100] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:41 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:41.773477 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a301787d-f580-43aa-9d33-d2fcfc991f33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:41.774132 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a301787d-f580-43aa-9d33-d2fcfc991f33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:41.780696 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a301787d-f580-43aa-9d33-d2fcfc991f33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:41.781149 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a301787d-f580-43aa-9d33-d2fcfc991f33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:41.781969 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a301787d-f580-43aa-9d33-d2fcfc991f33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:41.782426 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a301787d-f580-43aa-9d33-d2fcfc991f33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:41.919155 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a301787d-f580-43aa-9d33-d2fcfc991f33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:41.926830 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a301787d-f580-43aa-9d33-d2fcfc991f33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.157178 Dec 15 14:13:41.927389 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 547/1101] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:41 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:42.382422 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c86e2083-18ac-495c-931b-1943c5915f49 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:42.383440 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c86e2083-18ac-495c-931b-1943c5915f49 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:42.394452 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c86e2083-18ac-495c-931b-1943c5915f49 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:42.394922 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c86e2083-18ac-495c-931b-1943c5915f49 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:42.395716 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c86e2083-18ac-495c-931b-1943c5915f49 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:42.396155 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c86e2083-18ac-495c-931b-1943c5915f49 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:42.556172 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c86e2083-18ac-495c-931b-1943c5915f49 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:42.569679 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c86e2083-18ac-495c-931b-1943c5915f49 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:42.572066 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c86e2083-18ac-495c-931b-1943c5915f49 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:42.573937 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c86e2083-18ac-495c-931b-1943c5915f49 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.197598 Dec 15 14:13:42.574726 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 555/1102] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:42 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:42.953176 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1235feba-d16b-4491-a939-fc3aa11275b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:42.954226 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1235feba-d16b-4491-a939-fc3aa11275b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:42.965387 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1235feba-d16b-4491-a939-fc3aa11275b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:42.966190 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1235feba-d16b-4491-a939-fc3aa11275b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:42.967827 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1235feba-d16b-4491-a939-fc3aa11275b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:42.968542 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1235feba-d16b-4491-a939-fc3aa11275b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:43.115327 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1235feba-d16b-4491-a939-fc3aa11275b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:43.123461 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1235feba-d16b-4491-a939-fc3aa11275b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.176540 Dec 15 14:13:43.124016 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 548/1103] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:42 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:43.600394 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-34ce45ab-b98b-4a1d-a528-de0895fc0433 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:43.601037 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-34ce45ab-b98b-4a1d-a528-de0895fc0433 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:43.608200 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34ce45ab-b98b-4a1d-a528-de0895fc0433 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:43.608653 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34ce45ab-b98b-4a1d-a528-de0895fc0433 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:43.609432 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34ce45ab-b98b-4a1d-a528-de0895fc0433 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:43.609909 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34ce45ab-b98b-4a1d-a528-de0895fc0433 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:43.750060 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-34ce45ab-b98b-4a1d-a528-de0895fc0433 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:43.758871 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-34ce45ab-b98b-4a1d-a528-de0895fc0433 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:43.760358 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-34ce45ab-b98b-4a1d-a528-de0895fc0433 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:43.761555 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-34ce45ab-b98b-4a1d-a528-de0895fc0433 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.167655 Dec 15 14:13:43.762183 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 556/1104] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:43 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:44.145056 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e9fa39d3-e0a9-44a9-946f-e10ae5580887 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:44.146208 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e9fa39d3-e0a9-44a9-946f-e10ae5580887 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:44.153182 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9fa39d3-e0a9-44a9-946f-e10ae5580887 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:44.153659 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9fa39d3-e0a9-44a9-946f-e10ae5580887 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:44.154510 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9fa39d3-e0a9-44a9-946f-e10ae5580887 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:44.154966 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9fa39d3-e0a9-44a9-946f-e10ae5580887 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:44.303429 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e9fa39d3-e0a9-44a9-946f-e10ae5580887 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:44.314150 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e9fa39d3-e0a9-44a9-946f-e10ae5580887 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.175327 Dec 15 14:13:44.315051 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 549/1105] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:44 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:44.780785 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6c83428f-6272-45ad-94cb-5734c331f0a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:44.781446 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6c83428f-6272-45ad-94cb-5734c331f0a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:44.788594 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c83428f-6272-45ad-94cb-5734c331f0a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:44.789050 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c83428f-6272-45ad-94cb-5734c331f0a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:44.789882 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c83428f-6272-45ad-94cb-5734c331f0a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:44.790329 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c83428f-6272-45ad-94cb-5734c331f0a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:44.930931 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6c83428f-6272-45ad-94cb-5734c331f0a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:44.939448 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6c83428f-6272-45ad-94cb-5734c331f0a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:44.940935 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6c83428f-6272-45ad-94cb-5734c331f0a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:44.942355 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6c83428f-6272-45ad-94cb-5734c331f0a4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.165640 Dec 15 14:13:44.942985 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 557/1106] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:44 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:45.335902 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c929644d-7670-4b82-81db-7e860ce0d925 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:45.336561 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c929644d-7670-4b82-81db-7e860ce0d925 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:45.343964 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c929644d-7670-4b82-81db-7e860ce0d925 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:45.344436 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c929644d-7670-4b82-81db-7e860ce0d925 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:45.345246 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c929644d-7670-4b82-81db-7e860ce0d925 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:45.345706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c929644d-7670-4b82-81db-7e860ce0d925 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:45.503810 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c929644d-7670-4b82-81db-7e860ce0d925 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:45.511852 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c929644d-7670-4b82-81db-7e860ce0d925 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.181811 Dec 15 14:13:45.512436 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 550/1107] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:45 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:45.960241 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-99f84cc3-3a32-403a-873d-13dbb74ee0cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:45.961010 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-99f84cc3-3a32-403a-873d-13dbb74ee0cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:45.967625 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99f84cc3-3a32-403a-873d-13dbb74ee0cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:45.968106 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99f84cc3-3a32-403a-873d-13dbb74ee0cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:45.968965 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99f84cc3-3a32-403a-873d-13dbb74ee0cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:45.969390 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99f84cc3-3a32-403a-873d-13dbb74ee0cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:46.106398 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-99f84cc3-3a32-403a-873d-13dbb74ee0cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:46.117890 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-99f84cc3-3a32-403a-873d-13dbb74ee0cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:46.119395 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-99f84cc3-3a32-403a-873d-13dbb74ee0cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:46.120576 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-99f84cc3-3a32-403a-873d-13dbb74ee0cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.164205 Dec 15 14:13:46.121152 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 558/1108] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:45 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:46.530233 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9171733d-72fd-422a-a5d0-cda15b599ee0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:46.530813 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9171733d-72fd-422a-a5d0-cda15b599ee0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:46.538252 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9171733d-72fd-422a-a5d0-cda15b599ee0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:46.538698 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9171733d-72fd-422a-a5d0-cda15b599ee0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:46.539470 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9171733d-72fd-422a-a5d0-cda15b599ee0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:46.539896 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9171733d-72fd-422a-a5d0-cda15b599ee0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:46.700600 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9171733d-72fd-422a-a5d0-cda15b599ee0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:46.714956 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9171733d-72fd-422a-a5d0-cda15b599ee0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.188376 Dec 15 14:13:46.715992 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 551/1109] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:46 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:47.143066 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cb63322f-b2e2-40b7-8df6-7001135fd1d1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:47.144108 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cb63322f-b2e2-40b7-8df6-7001135fd1d1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:47.155298 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb63322f-b2e2-40b7-8df6-7001135fd1d1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:47.155991 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb63322f-b2e2-40b7-8df6-7001135fd1d1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:47.157286 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb63322f-b2e2-40b7-8df6-7001135fd1d1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:47.158081 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb63322f-b2e2-40b7-8df6-7001135fd1d1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:47.319477 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cb63322f-b2e2-40b7-8df6-7001135fd1d1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:47.328703 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cb63322f-b2e2-40b7-8df6-7001135fd1d1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:47.330223 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cb63322f-b2e2-40b7-8df6-7001135fd1d1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:47.331392 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cb63322f-b2e2-40b7-8df6-7001135fd1d1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.194594 Dec 15 14:13:47.331969 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 559/1110] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:47 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:47.739849 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-316a232a-aa57-40fd-8b01-68acb229d7ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:47.740847 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-316a232a-aa57-40fd-8b01-68acb229d7ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:47.749031 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-316a232a-aa57-40fd-8b01-68acb229d7ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:47.749478 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-316a232a-aa57-40fd-8b01-68acb229d7ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:47.750269 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-316a232a-aa57-40fd-8b01-68acb229d7ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:47.750695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-316a232a-aa57-40fd-8b01-68acb229d7ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:47.897383 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-316a232a-aa57-40fd-8b01-68acb229d7ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:47.905286 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-316a232a-aa57-40fd-8b01-68acb229d7ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.171761 Dec 15 14:13:47.905914 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 552/1111] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:47 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:48.354612 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-19441d03-3d98-4f90-8351-4f37b20e0789 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:48.355610 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-19441d03-3d98-4f90-8351-4f37b20e0789 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:48.366688 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-19441d03-3d98-4f90-8351-4f37b20e0789 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:48.367497 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-19441d03-3d98-4f90-8351-4f37b20e0789 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:48.368323 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-19441d03-3d98-4f90-8351-4f37b20e0789 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:48.368762 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-19441d03-3d98-4f90-8351-4f37b20e0789 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:48.513662 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-19441d03-3d98-4f90-8351-4f37b20e0789 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:48.522837 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-19441d03-3d98-4f90-8351-4f37b20e0789 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:48.524397 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-19441d03-3d98-4f90-8351-4f37b20e0789 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:48.525798 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-19441d03-3d98-4f90-8351-4f37b20e0789 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.177718 Dec 15 14:13:48.526281 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 560/1112] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:48 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:48.923660 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5088ea05-3810-4846-82f8-f6107554a648 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:48.924286 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5088ea05-3810-4846-82f8-f6107554a648 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:48.933681 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5088ea05-3810-4846-82f8-f6107554a648 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:48.934341 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5088ea05-3810-4846-82f8-f6107554a648 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:48.935514 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5088ea05-3810-4846-82f8-f6107554a648 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:48.936173 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5088ea05-3810-4846-82f8-f6107554a648 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:49.087848 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5088ea05-3810-4846-82f8-f6107554a648 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:49.097082 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5088ea05-3810-4846-82f8-f6107554a648 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.178058 Dec 15 14:13:49.097851 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 553/1113] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:48 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:49.545495 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5d07c338-754c-4deb-92de-97ec4e09ed68 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:49.546162 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5d07c338-754c-4deb-92de-97ec4e09ed68 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:49.553648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d07c338-754c-4deb-92de-97ec4e09ed68 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:49.554168 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d07c338-754c-4deb-92de-97ec4e09ed68 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:49.555643 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d07c338-754c-4deb-92de-97ec4e09ed68 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:49.556135 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d07c338-754c-4deb-92de-97ec4e09ed68 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:49.712639 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5d07c338-754c-4deb-92de-97ec4e09ed68 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:49.721966 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5d07c338-754c-4deb-92de-97ec4e09ed68 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:49.723482 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5d07c338-754c-4deb-92de-97ec4e09ed68 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:49.724651 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5d07c338-754c-4deb-92de-97ec4e09ed68 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.183311 Dec 15 14:13:49.725221 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 561/1114] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:49 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:50.116642 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-05eb3d06-39dc-4f0e-ba70-bbb5ac1341b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:50.117577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-05eb3d06-39dc-4f0e-ba70-bbb5ac1341b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:50.126390 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05eb3d06-39dc-4f0e-ba70-bbb5ac1341b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:50.126936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05eb3d06-39dc-4f0e-ba70-bbb5ac1341b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:50.128135 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05eb3d06-39dc-4f0e-ba70-bbb5ac1341b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:50.128662 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05eb3d06-39dc-4f0e-ba70-bbb5ac1341b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:50.274145 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-05eb3d06-39dc-4f0e-ba70-bbb5ac1341b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:50.286782 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-05eb3d06-39dc-4f0e-ba70-bbb5ac1341b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.175073 Dec 15 14:13:50.287363 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 554/1115] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:50 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:50.743974 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-94bc7534-cd11-48d0-9b59-c4da896e768c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:50.744642 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-94bc7534-cd11-48d0-9b59-c4da896e768c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:50.751395 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-94bc7534-cd11-48d0-9b59-c4da896e768c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:50.751930 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-94bc7534-cd11-48d0-9b59-c4da896e768c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:50.752724 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-94bc7534-cd11-48d0-9b59-c4da896e768c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:50.753164 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-94bc7534-cd11-48d0-9b59-c4da896e768c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:50.906351 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-94bc7534-cd11-48d0-9b59-c4da896e768c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:50.917100 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-94bc7534-cd11-48d0-9b59-c4da896e768c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:50.918640 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-94bc7534-cd11-48d0-9b59-c4da896e768c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:50.919808 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-94bc7534-cd11-48d0-9b59-c4da896e768c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.179941 Dec 15 14:13:50.920366 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 562/1116] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:50 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:51.304288 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cf12b879-39a8-41ce-ac2a-f3168f03921f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:51.304999 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cf12b879-39a8-41ce-ac2a-f3168f03921f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:51.311788 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf12b879-39a8-41ce-ac2a-f3168f03921f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:51.312327 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf12b879-39a8-41ce-ac2a-f3168f03921f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:51.313113 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf12b879-39a8-41ce-ac2a-f3168f03921f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:51.313542 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf12b879-39a8-41ce-ac2a-f3168f03921f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:51.466676 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cf12b879-39a8-41ce-ac2a-f3168f03921f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:51.477945 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cf12b879-39a8-41ce-ac2a-f3168f03921f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.177218 Dec 15 14:13:51.478664 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 555/1117] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:51 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:51.946910 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fab6de8f-d54f-4b07-af75-62762ca46106 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:51.947534 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fab6de8f-d54f-4b07-af75-62762ca46106 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:51.955621 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fab6de8f-d54f-4b07-af75-62762ca46106 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:51.956111 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fab6de8f-d54f-4b07-af75-62762ca46106 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:51.957011 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fab6de8f-d54f-4b07-af75-62762ca46106 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:51.957499 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fab6de8f-d54f-4b07-af75-62762ca46106 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:52.115812 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fab6de8f-d54f-4b07-af75-62762ca46106 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:52.125438 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fab6de8f-d54f-4b07-af75-62762ca46106 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:52.127026 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fab6de8f-d54f-4b07-af75-62762ca46106 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:52.128194 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fab6de8f-d54f-4b07-af75-62762ca46106 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.186578 Dec 15 14:13:52.128764 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 563/1118] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:51 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:52.502128 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a34f1cce-77a1-40fb-bb0f-b744bf74f6c8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:52.503069 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a34f1cce-77a1-40fb-bb0f-b744bf74f6c8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:52.512224 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a34f1cce-77a1-40fb-bb0f-b744bf74f6c8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:52.512690 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a34f1cce-77a1-40fb-bb0f-b744bf74f6c8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:52.513498 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a34f1cce-77a1-40fb-bb0f-b744bf74f6c8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:52.514186 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a34f1cce-77a1-40fb-bb0f-b744bf74f6c8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:52.665241 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a34f1cce-77a1-40fb-bb0f-b744bf74f6c8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:52.673122 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a34f1cce-77a1-40fb-bb0f-b744bf74f6c8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.178799 Dec 15 14:13:52.673734 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 556/1119] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:52 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:53.146573 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-106c4e82-02cb-46a9-bfe3-d86c32c6ee34 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:53.147184 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-106c4e82-02cb-46a9-bfe3-d86c32c6ee34 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:53.154425 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-106c4e82-02cb-46a9-bfe3-d86c32c6ee34 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:53.154899 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-106c4e82-02cb-46a9-bfe3-d86c32c6ee34 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:53.155669 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-106c4e82-02cb-46a9-bfe3-d86c32c6ee34 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:53.156101 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-106c4e82-02cb-46a9-bfe3-d86c32c6ee34 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:53.297272 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-106c4e82-02cb-46a9-bfe3-d86c32c6ee34 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:53.306098 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-106c4e82-02cb-46a9-bfe3-d86c32c6ee34 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:53.307587 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-106c4e82-02cb-46a9-bfe3-d86c32c6ee34 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:53.308733 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-106c4e82-02cb-46a9-bfe3-d86c32c6ee34 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.165963 Dec 15 14:13:53.309300 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 564/1120] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:53 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:53.694640 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-330ff8c4-beff-4999-a210-986daf1d5804 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:53.696374 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-330ff8c4-beff-4999-a210-986daf1d5804 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:53.707777 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-330ff8c4-beff-4999-a210-986daf1d5804 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:53.708529 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-330ff8c4-beff-4999-a210-986daf1d5804 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:53.709878 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-330ff8c4-beff-4999-a210-986daf1d5804 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:53.710609 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-330ff8c4-beff-4999-a210-986daf1d5804 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:53.865954 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-330ff8c4-beff-4999-a210-986daf1d5804 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:53.877775 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-330ff8c4-beff-4999-a210-986daf1d5804 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.189325 Dec 15 14:13:53.878561 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 557/1121] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:53 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:54.335705 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1789c998-4f8e-4f7c-892c-4dd29196b1c2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:54.336820 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1789c998-4f8e-4f7c-892c-4dd29196b1c2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:54.344071 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1789c998-4f8e-4f7c-892c-4dd29196b1c2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:54.344515 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1789c998-4f8e-4f7c-892c-4dd29196b1c2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:54.345309 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1789c998-4f8e-4f7c-892c-4dd29196b1c2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:54.345775 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1789c998-4f8e-4f7c-892c-4dd29196b1c2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:54.500842 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1789c998-4f8e-4f7c-892c-4dd29196b1c2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:54.510189 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1789c998-4f8e-4f7c-892c-4dd29196b1c2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:54.511585 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1789c998-4f8e-4f7c-892c-4dd29196b1c2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:54.512748 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1789c998-4f8e-4f7c-892c-4dd29196b1c2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.184117 Dec 15 14:13:54.513339 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 565/1122] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:54 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:54.899450 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-08821aed-ed56-4035-8cef-b12ef98b827f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:54.900542 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-08821aed-ed56-4035-8cef-b12ef98b827f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:54.911341 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-08821aed-ed56-4035-8cef-b12ef98b827f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:54.912076 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-08821aed-ed56-4035-8cef-b12ef98b827f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:54.913336 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-08821aed-ed56-4035-8cef-b12ef98b827f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:54.914208 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-08821aed-ed56-4035-8cef-b12ef98b827f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:55.055767 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-08821aed-ed56-4035-8cef-b12ef98b827f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:55.063420 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-08821aed-ed56-4035-8cef-b12ef98b827f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.170311 Dec 15 14:13:55.063986 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 558/1123] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:54 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:55.532259 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b02988fe-5a38-49e4-9d10-8e55ea8b264d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:55.532846 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b02988fe-5a38-49e4-9d10-8e55ea8b264d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:55.539637 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b02988fe-5a38-49e4-9d10-8e55ea8b264d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:55.540075 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b02988fe-5a38-49e4-9d10-8e55ea8b264d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:55.540861 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b02988fe-5a38-49e4-9d10-8e55ea8b264d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:55.541289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b02988fe-5a38-49e4-9d10-8e55ea8b264d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:55.694105 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b02988fe-5a38-49e4-9d10-8e55ea8b264d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:55.703279 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b02988fe-5a38-49e4-9d10-8e55ea8b264d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:55.704759 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b02988fe-5a38-49e4-9d10-8e55ea8b264d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:55.705944 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b02988fe-5a38-49e4-9d10-8e55ea8b264d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.177464 Dec 15 14:13:55.706488 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 566/1124] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:55 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:56.084774 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-298fa2c6-b4cb-463a-8b90-9de3a1fe3027 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:56.085783 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-298fa2c6-b4cb-463a-8b90-9de3a1fe3027 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:56.097275 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-298fa2c6-b4cb-463a-8b90-9de3a1fe3027 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:56.098067 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-298fa2c6-b4cb-463a-8b90-9de3a1fe3027 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:56.099313 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-298fa2c6-b4cb-463a-8b90-9de3a1fe3027 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:56.100068 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-298fa2c6-b4cb-463a-8b90-9de3a1fe3027 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:56.259295 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-298fa2c6-b4cb-463a-8b90-9de3a1fe3027 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:56.267254 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-298fa2c6-b4cb-463a-8b90-9de3a1fe3027 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.188690 Dec 15 14:13:56.267815 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 559/1125] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:56 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:56.729772 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-26abc164-d9db-4af5-905e-07f28dd414cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:56.730706 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-26abc164-d9db-4af5-905e-07f28dd414cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:56.741558 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-26abc164-d9db-4af5-905e-07f28dd414cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:56.742705 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-26abc164-d9db-4af5-905e-07f28dd414cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:56.744031 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-26abc164-d9db-4af5-905e-07f28dd414cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:56.744706 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-26abc164-d9db-4af5-905e-07f28dd414cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:56.892471 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-26abc164-d9db-4af5-905e-07f28dd414cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:56.905085 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-26abc164-d9db-4af5-905e-07f28dd414cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:56.907277 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-26abc164-d9db-4af5-905e-07f28dd414cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:56.908738 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-26abc164-d9db-4af5-905e-07f28dd414cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.185770 Dec 15 14:13:56.909386 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 567/1126] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:56 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:57.289026 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-452318d9-7dba-4c9c-91e1-ed905d153ab8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:57.289907 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-452318d9-7dba-4c9c-91e1-ed905d153ab8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:57.300879 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-452318d9-7dba-4c9c-91e1-ed905d153ab8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:57.301695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-452318d9-7dba-4c9c-91e1-ed905d153ab8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:57.302986 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-452318d9-7dba-4c9c-91e1-ed905d153ab8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:57.303720 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-452318d9-7dba-4c9c-91e1-ed905d153ab8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:57.442042 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-452318d9-7dba-4c9c-91e1-ed905d153ab8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:57.453809 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-452318d9-7dba-4c9c-91e1-ed905d153ab8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.171038 Dec 15 14:13:57.454572 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 560/1127] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:57 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:57.931625 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f9e9e504-7827-4ffb-a8fa-38df1eeeaff7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:57.932239 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f9e9e504-7827-4ffb-a8fa-38df1eeeaff7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:57.939014 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9e9e504-7827-4ffb-a8fa-38df1eeeaff7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:57.939464 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9e9e504-7827-4ffb-a8fa-38df1eeeaff7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:57.940251 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9e9e504-7827-4ffb-a8fa-38df1eeeaff7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:57.940767 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9e9e504-7827-4ffb-a8fa-38df1eeeaff7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:58.088027 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f9e9e504-7827-4ffb-a8fa-38df1eeeaff7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:58.097917 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f9e9e504-7827-4ffb-a8fa-38df1eeeaff7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:58.099413 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f9e9e504-7827-4ffb-a8fa-38df1eeeaff7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:58.100609 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f9e9e504-7827-4ffb-a8fa-38df1eeeaff7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.174678 Dec 15 14:13:58.101148 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 568/1128] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:57 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:58.471896 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e7a2929b-3fc0-4844-9ed3-30d54c14dc41 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:58.472501 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e7a2929b-3fc0-4844-9ed3-30d54c14dc41 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:58.479468 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e7a2929b-3fc0-4844-9ed3-30d54c14dc41 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:58.479924 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e7a2929b-3fc0-4844-9ed3-30d54c14dc41 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:58.480706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e7a2929b-3fc0-4844-9ed3-30d54c14dc41 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:58.481143 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e7a2929b-3fc0-4844-9ed3-30d54c14dc41 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:58.635627 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e7a2929b-3fc0-4844-9ed3-30d54c14dc41 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:58.643168 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e7a2929b-3fc0-4844-9ed3-30d54c14dc41 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.175050 Dec 15 14:13:58.643756 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 561/1129] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:58 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:59.128849 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-caf9bb02-58c9-4d6a-bc70-19730914b087 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:59.129879 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-caf9bb02-58c9-4d6a-bc70-19730914b087 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:59.139289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-caf9bb02-58c9-4d6a-bc70-19730914b087 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:59.140159 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-caf9bb02-58c9-4d6a-bc70-19730914b087 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:59.140951 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-caf9bb02-58c9-4d6a-bc70-19730914b087 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:59.142987 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-caf9bb02-58c9-4d6a-bc70-19730914b087 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:59.279263 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-caf9bb02-58c9-4d6a-bc70-19730914b087 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:59.287738 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-caf9bb02-58c9-4d6a-bc70-19730914b087 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:59.289243 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-caf9bb02-58c9-4d6a-bc70-19730914b087 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:59.290532 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-caf9bb02-58c9-4d6a-bc70-19730914b087 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.167963 Dec 15 14:13:59.291084 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 569/1130] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:59 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:59.660543 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f9313c83-027d-482f-9c69-e88164af0886 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:59.661206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f9313c83-027d-482f-9c69-e88164af0886 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:59.667939 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f9313c83-027d-482f-9c69-e88164af0886 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:59.668401 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f9313c83-027d-482f-9c69-e88164af0886 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:59.669189 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f9313c83-027d-482f-9c69-e88164af0886 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:59.669642 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f9313c83-027d-482f-9c69-e88164af0886 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:59.812934 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f9313c83-027d-482f-9c69-e88164af0886 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:59.820841 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f9313c83-027d-482f-9c69-e88164af0886 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.164344 Dec 15 14:13:59.821527 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 562/1131] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:59 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:00.311252 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f87176f8-224a-42fc-ae10-931713a0fae1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:00.312131 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f87176f8-224a-42fc-ae10-931713a0fae1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:00.321055 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f87176f8-224a-42fc-ae10-931713a0fae1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:00.321602 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f87176f8-224a-42fc-ae10-931713a0fae1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:00.322739 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f87176f8-224a-42fc-ae10-931713a0fae1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:00.323320 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f87176f8-224a-42fc-ae10-931713a0fae1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:00.479952 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f87176f8-224a-42fc-ae10-931713a0fae1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:00.489540 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f87176f8-224a-42fc-ae10-931713a0fae1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:00.491077 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f87176f8-224a-42fc-ae10-931713a0fae1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:00.492277 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f87176f8-224a-42fc-ae10-931713a0fae1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.186138 Dec 15 14:14:00.492853 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 570/1132] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:00 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:00.838658 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9304d7e4-6b44-4d6b-a9f9-c6419942b563 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:00.839339 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9304d7e4-6b44-4d6b-a9f9-c6419942b563 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:00.849392 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9304d7e4-6b44-4d6b-a9f9-c6419942b563 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:00.849901 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9304d7e4-6b44-4d6b-a9f9-c6419942b563 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:00.850685 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9304d7e4-6b44-4d6b-a9f9-c6419942b563 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:00.851122 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9304d7e4-6b44-4d6b-a9f9-c6419942b563 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:01.003941 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9304d7e4-6b44-4d6b-a9f9-c6419942b563 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:01.012380 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9304d7e4-6b44-4d6b-a9f9-c6419942b563 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.177658 Dec 15 14:14:01.013265 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 563/1133] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:00 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:01.514379 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1eba5dd2-a2ef-41d9-9823-0c33f238c924 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:01.514995 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1eba5dd2-a2ef-41d9-9823-0c33f238c924 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:01.521973 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1eba5dd2-a2ef-41d9-9823-0c33f238c924 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:01.522417 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1eba5dd2-a2ef-41d9-9823-0c33f238c924 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:01.523186 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1eba5dd2-a2ef-41d9-9823-0c33f238c924 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:01.523616 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1eba5dd2-a2ef-41d9-9823-0c33f238c924 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:01.670011 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1eba5dd2-a2ef-41d9-9823-0c33f238c924 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:01.678920 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1eba5dd2-a2ef-41d9-9823-0c33f238c924 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:01.680406 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1eba5dd2-a2ef-41d9-9823-0c33f238c924 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:01.682008 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1eba5dd2-a2ef-41d9-9823-0c33f238c924 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.172174 Dec 15 14:14:01.682584 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 571/1134] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:01 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:02.034234 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-54af7b9e-21bd-4a94-876e-46fc68a6da15 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:02.035122 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-54af7b9e-21bd-4a94-876e-46fc68a6da15 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:02.043871 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54af7b9e-21bd-4a94-876e-46fc68a6da15 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:02.044330 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54af7b9e-21bd-4a94-876e-46fc68a6da15 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:02.045101 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54af7b9e-21bd-4a94-876e-46fc68a6da15 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:02.045531 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54af7b9e-21bd-4a94-876e-46fc68a6da15 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:02.207402 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-54af7b9e-21bd-4a94-876e-46fc68a6da15 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:02.220486 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-54af7b9e-21bd-4a94-876e-46fc68a6da15 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.192700 Dec 15 14:14:02.221402 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 564/1135] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:02 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:02.705228 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e841208a-b1ca-4ffc-a087-d34704e4aa7c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:02.706203 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e841208a-b1ca-4ffc-a087-d34704e4aa7c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:02.715479 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e841208a-b1ca-4ffc-a087-d34704e4aa7c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:02.716248 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e841208a-b1ca-4ffc-a087-d34704e4aa7c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:02.717036 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e841208a-b1ca-4ffc-a087-d34704e4aa7c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:02.717476 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e841208a-b1ca-4ffc-a087-d34704e4aa7c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:02.861447 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e841208a-b1ca-4ffc-a087-d34704e4aa7c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:02.870227 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e841208a-b1ca-4ffc-a087-d34704e4aa7c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:02.871722 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e841208a-b1ca-4ffc-a087-d34704e4aa7c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:02.872906 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e841208a-b1ca-4ffc-a087-d34704e4aa7c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.174164 Dec 15 14:14:02.873486 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 572/1136] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:02 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:03.244309 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bb6eae00-bc26-460b-b50e-855c921d6429 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:03.244920 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bb6eae00-bc26-460b-b50e-855c921d6429 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:03.252242 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb6eae00-bc26-460b-b50e-855c921d6429 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:03.252748 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb6eae00-bc26-460b-b50e-855c921d6429 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:03.253647 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb6eae00-bc26-460b-b50e-855c921d6429 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:03.254164 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb6eae00-bc26-460b-b50e-855c921d6429 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:03.398316 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bb6eae00-bc26-460b-b50e-855c921d6429 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:03.406908 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bb6eae00-bc26-460b-b50e-855c921d6429 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.168649 Dec 15 14:14:03.407533 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 565/1137] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:03 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:03.892586 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7cf4f9a5-d57e-4ddd-b7d3-12f19291ed92 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:03.893400 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7cf4f9a5-d57e-4ddd-b7d3-12f19291ed92 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:03.902079 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7cf4f9a5-d57e-4ddd-b7d3-12f19291ed92 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:03.902520 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7cf4f9a5-d57e-4ddd-b7d3-12f19291ed92 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:03.903323 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7cf4f9a5-d57e-4ddd-b7d3-12f19291ed92 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:03.903760 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7cf4f9a5-d57e-4ddd-b7d3-12f19291ed92 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:04.087520 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7cf4f9a5-d57e-4ddd-b7d3-12f19291ed92 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:04.098692 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7cf4f9a5-d57e-4ddd-b7d3-12f19291ed92 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:04.101179 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7cf4f9a5-d57e-4ddd-b7d3-12f19291ed92 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:04.102534 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7cf4f9a5-d57e-4ddd-b7d3-12f19291ed92 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.214158 Dec 15 14:14:04.103106 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 573/1138] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:03 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:04.425435 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4b38073c-9477-415e-8475-a0df0a6cfa0c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:04.426065 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4b38073c-9477-415e-8475-a0df0a6cfa0c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:04.437486 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4b38073c-9477-415e-8475-a0df0a6cfa0c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:04.437980 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4b38073c-9477-415e-8475-a0df0a6cfa0c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:04.438790 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4b38073c-9477-415e-8475-a0df0a6cfa0c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:04.439229 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4b38073c-9477-415e-8475-a0df0a6cfa0c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:04.606177 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4b38073c-9477-415e-8475-a0df0a6cfa0c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:04.617737 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4b38073c-9477-415e-8475-a0df0a6cfa0c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.195958 Dec 15 14:14:04.618668 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 566/1139] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:04 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:05.122219 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-88c08cab-24da-4f3e-bfd8-c2f06dcffa12 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:05.122815 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-88c08cab-24da-4f3e-bfd8-c2f06dcffa12 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:05.129099 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88c08cab-24da-4f3e-bfd8-c2f06dcffa12 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:05.129552 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88c08cab-24da-4f3e-bfd8-c2f06dcffa12 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:05.130365 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88c08cab-24da-4f3e-bfd8-c2f06dcffa12 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:05.130808 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88c08cab-24da-4f3e-bfd8-c2f06dcffa12 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:05.267480 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-88c08cab-24da-4f3e-bfd8-c2f06dcffa12 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:05.276659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-88c08cab-24da-4f3e-bfd8-c2f06dcffa12 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:05.278241 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-88c08cab-24da-4f3e-bfd8-c2f06dcffa12 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:05.279362 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-88c08cab-24da-4f3e-bfd8-c2f06dcffa12 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.161568 Dec 15 14:14:05.279894 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 574/1140] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:05 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:05.634629 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-baa56d77-4861-4617-84b8-8f6e14b2ead4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:05.635358 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-baa56d77-4861-4617-84b8-8f6e14b2ead4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:05.642612 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-baa56d77-4861-4617-84b8-8f6e14b2ead4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:05.643150 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-baa56d77-4861-4617-84b8-8f6e14b2ead4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:05.644086 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-baa56d77-4861-4617-84b8-8f6e14b2ead4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:05.644775 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-baa56d77-4861-4617-84b8-8f6e14b2ead4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:05.804223 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-baa56d77-4861-4617-84b8-8f6e14b2ead4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:05.814098 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-baa56d77-4861-4617-84b8-8f6e14b2ead4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.183282 Dec 15 14:14:05.814833 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 567/1141] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:05 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:06.303169 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8d263ea8-868e-4eae-b540-c8db6504a947 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:06.304196 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8d263ea8-868e-4eae-b540-c8db6504a947 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:06.315865 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d263ea8-868e-4eae-b540-c8db6504a947 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:06.316612 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d263ea8-868e-4eae-b540-c8db6504a947 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:06.317949 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d263ea8-868e-4eae-b540-c8db6504a947 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:06.318673 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d263ea8-868e-4eae-b540-c8db6504a947 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:06.475857 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8d263ea8-868e-4eae-b540-c8db6504a947 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:06.485466 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8d263ea8-868e-4eae-b540-c8db6504a947 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:06.486961 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8d263ea8-868e-4eae-b540-c8db6504a947 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:06.488127 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8d263ea8-868e-4eae-b540-c8db6504a947 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.192113 Dec 15 14:14:06.488728 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 575/1142] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:06 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:06.830788 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-24b8922c-1ddb-4857-938d-b0c80e4b14c4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:06.831416 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-24b8922c-1ddb-4857-938d-b0c80e4b14c4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:06.838530 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24b8922c-1ddb-4857-938d-b0c80e4b14c4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:06.839670 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24b8922c-1ddb-4857-938d-b0c80e4b14c4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:06.841088 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24b8922c-1ddb-4857-938d-b0c80e4b14c4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:06.841627 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24b8922c-1ddb-4857-938d-b0c80e4b14c4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:06.995430 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-24b8922c-1ddb-4857-938d-b0c80e4b14c4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:07.003456 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-24b8922c-1ddb-4857-938d-b0c80e4b14c4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.176546 Dec 15 14:14:07.004018 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 568/1143] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:06 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:07.511601 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-09926b08-78f3-492e-8b01-1458acb1c8ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:07.512715 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-09926b08-78f3-492e-8b01-1458acb1c8ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:07.523902 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-09926b08-78f3-492e-8b01-1458acb1c8ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:07.524651 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-09926b08-78f3-492e-8b01-1458acb1c8ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:07.526088 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-09926b08-78f3-492e-8b01-1458acb1c8ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:07.527066 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-09926b08-78f3-492e-8b01-1458acb1c8ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:07.665417 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-09926b08-78f3-492e-8b01-1458acb1c8ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:07.675006 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-09926b08-78f3-492e-8b01-1458acb1c8ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:07.676512 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-09926b08-78f3-492e-8b01-1458acb1c8ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:07.677725 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-09926b08-78f3-492e-8b01-1458acb1c8ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.172597 Dec 15 14:14:07.678296 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 576/1144] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:07 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:08.025594 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-39b54ef0-8567-4f53-9056-321b6218ce66 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:08.026665 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-39b54ef0-8567-4f53-9056-321b6218ce66 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:08.038252 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39b54ef0-8567-4f53-9056-321b6218ce66 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:08.039075 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39b54ef0-8567-4f53-9056-321b6218ce66 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:08.040414 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39b54ef0-8567-4f53-9056-321b6218ce66 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:08.041179 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39b54ef0-8567-4f53-9056-321b6218ce66 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:08.189957 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-39b54ef0-8567-4f53-9056-321b6218ce66 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:08.201811 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-39b54ef0-8567-4f53-9056-321b6218ce66 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.182341 Dec 15 14:14:08.202635 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 569/1145] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:08 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:08.703519 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-966b8752-65be-4d81-b6b6-801cec582dfa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:08.704192 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-966b8752-65be-4d81-b6b6-801cec582dfa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:08.712254 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-966b8752-65be-4d81-b6b6-801cec582dfa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:08.713025 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-966b8752-65be-4d81-b6b6-801cec582dfa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:08.714021 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-966b8752-65be-4d81-b6b6-801cec582dfa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:08.714548 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-966b8752-65be-4d81-b6b6-801cec582dfa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:08.863834 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-966b8752-65be-4d81-b6b6-801cec582dfa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:08.872555 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-966b8752-65be-4d81-b6b6-801cec582dfa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:08.877291 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-966b8752-65be-4d81-b6b6-801cec582dfa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:08.878617 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-966b8752-65be-4d81-b6b6-801cec582dfa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.179855 Dec 15 14:14:08.879175 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 577/1146] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:08 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:09.224362 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-93bf9e4b-7821-4f12-945d-4ea211737e84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:09.224956 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-93bf9e4b-7821-4f12-945d-4ea211737e84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:09.232031 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-93bf9e4b-7821-4f12-945d-4ea211737e84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:09.232491 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-93bf9e4b-7821-4f12-945d-4ea211737e84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:09.233284 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-93bf9e4b-7821-4f12-945d-4ea211737e84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:09.233770 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-93bf9e4b-7821-4f12-945d-4ea211737e84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:09.384620 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-93bf9e4b-7821-4f12-945d-4ea211737e84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:09.392678 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-93bf9e4b-7821-4f12-945d-4ea211737e84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.172198 Dec 15 14:14:09.393226 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 570/1147] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:09 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:09.905626 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-79ca1768-ae9e-4279-bef1-ade62dcc1f72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:09.906458 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-79ca1768-ae9e-4279-bef1-ade62dcc1f72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:09.916119 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79ca1768-ae9e-4279-bef1-ade62dcc1f72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:09.916762 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79ca1768-ae9e-4279-bef1-ade62dcc1f72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:09.918036 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79ca1768-ae9e-4279-bef1-ade62dcc1f72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:09.918738 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79ca1768-ae9e-4279-bef1-ade62dcc1f72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:10.068060 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-79ca1768-ae9e-4279-bef1-ade62dcc1f72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:10.076490 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-79ca1768-ae9e-4279-bef1-ade62dcc1f72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:10.078021 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-79ca1768-ae9e-4279-bef1-ade62dcc1f72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:10.079187 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-79ca1768-ae9e-4279-bef1-ade62dcc1f72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.179366 Dec 15 14:14:10.079793 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 578/1148] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:09 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:10.424502 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-abde6574-1436-40c9-818d-cf6a9e85239e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:10.425563 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-abde6574-1436-40c9-818d-cf6a9e85239e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:10.436665 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abde6574-1436-40c9-818d-cf6a9e85239e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:10.437255 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abde6574-1436-40c9-818d-cf6a9e85239e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:10.438376 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abde6574-1436-40c9-818d-cf6a9e85239e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:10.438895 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abde6574-1436-40c9-818d-cf6a9e85239e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:10.597002 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-abde6574-1436-40c9-818d-cf6a9e85239e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:10.607191 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-abde6574-1436-40c9-818d-cf6a9e85239e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.192982 Dec 15 14:14:10.607920 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 571/1149] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:10 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:11.104155 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d878c765-4384-4047-95f6-1ddc9c5d7d37 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:11.104784 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d878c765-4384-4047-95f6-1ddc9c5d7d37 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:11.111606 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d878c765-4384-4047-95f6-1ddc9c5d7d37 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:11.112077 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d878c765-4384-4047-95f6-1ddc9c5d7d37 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:11.112867 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d878c765-4384-4047-95f6-1ddc9c5d7d37 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:11.113304 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d878c765-4384-4047-95f6-1ddc9c5d7d37 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:11.258818 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d878c765-4384-4047-95f6-1ddc9c5d7d37 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:11.267734 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d878c765-4384-4047-95f6-1ddc9c5d7d37 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:11.269345 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d878c765-4384-4047-95f6-1ddc9c5d7d37 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:11.270621 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d878c765-4384-4047-95f6-1ddc9c5d7d37 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.170386 Dec 15 14:14:11.271190 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 579/1150] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:11 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:11.628689 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3030159c-fa96-4f81-a634-3255d2774103 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:11.629839 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3030159c-fa96-4f81-a634-3255d2774103 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:11.639753 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3030159c-fa96-4f81-a634-3255d2774103 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:11.640212 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3030159c-fa96-4f81-a634-3255d2774103 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:11.641017 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3030159c-fa96-4f81-a634-3255d2774103 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:11.641452 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3030159c-fa96-4f81-a634-3255d2774103 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:11.800320 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3030159c-fa96-4f81-a634-3255d2774103 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:11.808164 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3030159c-fa96-4f81-a634-3255d2774103 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.185653 Dec 15 14:14:11.808721 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 572/1151] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:11 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:12.289646 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ca1dc365-a2aa-40b6-8f7c-8f9c9db60360 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:12.290407 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ca1dc365-a2aa-40b6-8f7c-8f9c9db60360 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:12.297547 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ca1dc365-a2aa-40b6-8f7c-8f9c9db60360 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:12.297999 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ca1dc365-a2aa-40b6-8f7c-8f9c9db60360 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:12.298795 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ca1dc365-a2aa-40b6-8f7c-8f9c9db60360 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:12.299252 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ca1dc365-a2aa-40b6-8f7c-8f9c9db60360 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:12.434060 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ca1dc365-a2aa-40b6-8f7c-8f9c9db60360 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:12.443274 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ca1dc365-a2aa-40b6-8f7c-8f9c9db60360 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:12.444784 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ca1dc365-a2aa-40b6-8f7c-8f9c9db60360 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:12.446006 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ca1dc365-a2aa-40b6-8f7c-8f9c9db60360 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.160309 Dec 15 14:14:12.446541 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 580/1152] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:12 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:12.826522 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8b93baf1-ceb1-4de6-8d11-26cc23b2978c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:12.827076 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8b93baf1-ceb1-4de6-8d11-26cc23b2978c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:12.834164 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b93baf1-ceb1-4de6-8d11-26cc23b2978c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:12.834608 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b93baf1-ceb1-4de6-8d11-26cc23b2978c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:12.835387 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b93baf1-ceb1-4de6-8d11-26cc23b2978c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:12.835812 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b93baf1-ceb1-4de6-8d11-26cc23b2978c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:12.981712 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8b93baf1-ceb1-4de6-8d11-26cc23b2978c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:12.990280 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8b93baf1-ceb1-4de6-8d11-26cc23b2978c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.167642 Dec 15 14:14:12.990855 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 573/1153] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:12 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:13.469808 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-303ef527-800f-431e-8b84-c1627624f0ed tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:13.470469 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-303ef527-800f-431e-8b84-c1627624f0ed tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:13.478610 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-303ef527-800f-431e-8b84-c1627624f0ed tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:13.479120 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-303ef527-800f-431e-8b84-c1627624f0ed tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:13.480042 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-303ef527-800f-431e-8b84-c1627624f0ed tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:13.480558 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-303ef527-800f-431e-8b84-c1627624f0ed tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:13.621158 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-303ef527-800f-431e-8b84-c1627624f0ed tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:13.630499 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-303ef527-800f-431e-8b84-c1627624f0ed tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:13.631997 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-303ef527-800f-431e-8b84-c1627624f0ed tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:13.633169 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-303ef527-800f-431e-8b84-c1627624f0ed tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.169110 Dec 15 14:14:13.633752 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 581/1154] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:13 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:14.011446 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-457d636a-1f30-47cb-be5d-454db0f77e0d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:14.012414 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-457d636a-1f30-47cb-be5d-454db0f77e0d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:14.023432 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-457d636a-1f30-47cb-be5d-454db0f77e0d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:14.024256 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-457d636a-1f30-47cb-be5d-454db0f77e0d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:14.025549 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-457d636a-1f30-47cb-be5d-454db0f77e0d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:14.026319 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-457d636a-1f30-47cb-be5d-454db0f77e0d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:14.182560 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-457d636a-1f30-47cb-be5d-454db0f77e0d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:14.190974 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-457d636a-1f30-47cb-be5d-454db0f77e0d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.185645 Dec 15 14:14:14.191534 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 574/1155] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:14 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:14.656248 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-63c154dc-b1d9-4e63-b1bc-5be91258ab26 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:14.657090 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-63c154dc-b1d9-4e63-b1bc-5be91258ab26 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:14.668656 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63c154dc-b1d9-4e63-b1bc-5be91258ab26 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:14.669346 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63c154dc-b1d9-4e63-b1bc-5be91258ab26 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:14.670605 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63c154dc-b1d9-4e63-b1bc-5be91258ab26 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:14.671049 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63c154dc-b1d9-4e63-b1bc-5be91258ab26 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:14.824442 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-63c154dc-b1d9-4e63-b1bc-5be91258ab26 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:14.833950 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-63c154dc-b1d9-4e63-b1bc-5be91258ab26 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:14.835443 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-63c154dc-b1d9-4e63-b1bc-5be91258ab26 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:14.836607 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-63c154dc-b1d9-4e63-b1bc-5be91258ab26 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.186903 Dec 15 14:14:14.837131 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 582/1156] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:14 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:15.211549 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-23b47549-cd03-4732-bba2-d68135182641 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:15.212481 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-23b47549-cd03-4732-bba2-d68135182641 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:15.222994 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-23b47549-cd03-4732-bba2-d68135182641 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:15.223681 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-23b47549-cd03-4732-bba2-d68135182641 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:15.224979 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-23b47549-cd03-4732-bba2-d68135182641 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:15.225669 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-23b47549-cd03-4732-bba2-d68135182641 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:15.372194 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-23b47549-cd03-4732-bba2-d68135182641 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:15.384173 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-23b47549-cd03-4732-bba2-d68135182641 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.178211 Dec 15 14:14:15.384867 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 575/1157] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:15 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:15.856225 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-483b6cd4-79c8-4273-96b6-ed16e9160a01 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:15.857718 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-483b6cd4-79c8-4273-96b6-ed16e9160a01 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:15.864291 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-483b6cd4-79c8-4273-96b6-ed16e9160a01 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:15.864732 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-483b6cd4-79c8-4273-96b6-ed16e9160a01 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:15.865525 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-483b6cd4-79c8-4273-96b6-ed16e9160a01 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:15.865987 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-483b6cd4-79c8-4273-96b6-ed16e9160a01 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:16.018310 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-483b6cd4-79c8-4273-96b6-ed16e9160a01 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:16.028547 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-483b6cd4-79c8-4273-96b6-ed16e9160a01 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:16.030143 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-483b6cd4-79c8-4273-96b6-ed16e9160a01 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:16.031245 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-483b6cd4-79c8-4273-96b6-ed16e9160a01 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.178834 Dec 15 14:14:16.032321 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 583/1158] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:15 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:16.406436 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-67d034f6-18cc-4920-ad85-9b4ba0cb77db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:16.407267 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-67d034f6-18cc-4920-ad85-9b4ba0cb77db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:16.416015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67d034f6-18cc-4920-ad85-9b4ba0cb77db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:16.416579 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67d034f6-18cc-4920-ad85-9b4ba0cb77db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:16.417571 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67d034f6-18cc-4920-ad85-9b4ba0cb77db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:16.418159 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67d034f6-18cc-4920-ad85-9b4ba0cb77db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:16.576844 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-67d034f6-18cc-4920-ad85-9b4ba0cb77db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:16.584379 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-67d034f6-18cc-4920-ad85-9b4ba0cb77db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.183827 Dec 15 14:14:16.584951 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 576/1159] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:16 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:17.054640 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-31944412-8060-493e-96d4-0752d721f180 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:17.055641 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-31944412-8060-493e-96d4-0752d721f180 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:17.064899 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31944412-8060-493e-96d4-0752d721f180 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:17.065350 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31944412-8060-493e-96d4-0752d721f180 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:17.066187 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31944412-8060-493e-96d4-0752d721f180 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:17.066621 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31944412-8060-493e-96d4-0752d721f180 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:17.221512 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-31944412-8060-493e-96d4-0752d721f180 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:17.229928 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-31944412-8060-493e-96d4-0752d721f180 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:17.231449 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-31944412-8060-493e-96d4-0752d721f180 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:17.232607 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-31944412-8060-493e-96d4-0752d721f180 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.184343 Dec 15 14:14:17.233164 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 584/1160] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:17 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:17.604756 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ba63f558-2c19-4faf-af07-a788a5de1315 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:17.605478 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ba63f558-2c19-4faf-af07-a788a5de1315 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:17.612622 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ba63f558-2c19-4faf-af07-a788a5de1315 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:17.613075 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ba63f558-2c19-4faf-af07-a788a5de1315 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:17.613890 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ba63f558-2c19-4faf-af07-a788a5de1315 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:17.614321 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ba63f558-2c19-4faf-af07-a788a5de1315 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:17.758685 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ba63f558-2c19-4faf-af07-a788a5de1315 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:17.768430 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ba63f558-2c19-4faf-af07-a788a5de1315 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.167179 Dec 15 14:14:17.769248 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 577/1161] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:17 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:18.255696 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8300c5fd-34c7-4fd6-9815-cfea42667153 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:18.256599 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8300c5fd-34c7-4fd6-9815-cfea42667153 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:18.266076 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8300c5fd-34c7-4fd6-9815-cfea42667153 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:18.266529 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8300c5fd-34c7-4fd6-9815-cfea42667153 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:18.267314 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8300c5fd-34c7-4fd6-9815-cfea42667153 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:18.267761 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8300c5fd-34c7-4fd6-9815-cfea42667153 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:18.418562 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8300c5fd-34c7-4fd6-9815-cfea42667153 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:18.428064 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8300c5fd-34c7-4fd6-9815-cfea42667153 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:18.429554 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8300c5fd-34c7-4fd6-9815-cfea42667153 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:18.430802 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8300c5fd-34c7-4fd6-9815-cfea42667153 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.181675 Dec 15 14:14:18.431362 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 585/1162] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:18 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:18.788748 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e4d4d07b-ff5d-44d2-bb17-95104911a8e7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:18.789351 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e4d4d07b-ff5d-44d2-bb17-95104911a8e7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:18.796073 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e4d4d07b-ff5d-44d2-bb17-95104911a8e7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:18.796519 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e4d4d07b-ff5d-44d2-bb17-95104911a8e7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:18.797299 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e4d4d07b-ff5d-44d2-bb17-95104911a8e7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:18.797776 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e4d4d07b-ff5d-44d2-bb17-95104911a8e7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:18.939292 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e4d4d07b-ff5d-44d2-bb17-95104911a8e7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:18.951303 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e4d4d07b-ff5d-44d2-bb17-95104911a8e7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.166436 Dec 15 14:14:18.951928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 578/1163] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:18 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:19.453602 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a0afefb3-3748-49c5-b11f-586d2d057158 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:19.454680 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a0afefb3-3748-49c5-b11f-586d2d057158 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:19.466021 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a0afefb3-3748-49c5-b11f-586d2d057158 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:19.466481 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a0afefb3-3748-49c5-b11f-586d2d057158 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:19.467244 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a0afefb3-3748-49c5-b11f-586d2d057158 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:19.467706 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a0afefb3-3748-49c5-b11f-586d2d057158 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:19.611204 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a0afefb3-3748-49c5-b11f-586d2d057158 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:19.620140 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a0afefb3-3748-49c5-b11f-586d2d057158 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:19.621643 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a0afefb3-3748-49c5-b11f-586d2d057158 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:19.622940 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a0afefb3-3748-49c5-b11f-586d2d057158 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.175586 Dec 15 14:14:19.623524 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 586/1164] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:19 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:19.969100 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9c28d616-8104-4b6a-a60d-79bf2aff9a1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:19.969706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9c28d616-8104-4b6a-a60d-79bf2aff9a1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:19.976726 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c28d616-8104-4b6a-a60d-79bf2aff9a1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:19.977191 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c28d616-8104-4b6a-a60d-79bf2aff9a1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:19.978213 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c28d616-8104-4b6a-a60d-79bf2aff9a1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:19.978655 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c28d616-8104-4b6a-a60d-79bf2aff9a1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:20.137423 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9c28d616-8104-4b6a-a60d-79bf2aff9a1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:20.145741 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9c28d616-8104-4b6a-a60d-79bf2aff9a1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.181174 Dec 15 14:14:20.146317 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 579/1165] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:19 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:20.643731 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-53de392b-f95c-4eab-b10c-72ecaa1a73d5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:20.644312 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-53de392b-f95c-4eab-b10c-72ecaa1a73d5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:20.651521 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53de392b-f95c-4eab-b10c-72ecaa1a73d5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:20.652006 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53de392b-f95c-4eab-b10c-72ecaa1a73d5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:20.652788 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53de392b-f95c-4eab-b10c-72ecaa1a73d5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:20.653228 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53de392b-f95c-4eab-b10c-72ecaa1a73d5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:20.801903 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-53de392b-f95c-4eab-b10c-72ecaa1a73d5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:20.810584 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-53de392b-f95c-4eab-b10c-72ecaa1a73d5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:20.812408 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-53de392b-f95c-4eab-b10c-72ecaa1a73d5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:20.813656 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-53de392b-f95c-4eab-b10c-72ecaa1a73d5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.174297 Dec 15 14:14:20.814252 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 587/1166] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:20 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:21.166653 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5dfd56b5-3ec0-485d-95d4-c53873e48b34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:21.167634 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5dfd56b5-3ec0-485d-95d4-c53873e48b34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:21.177579 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5dfd56b5-3ec0-485d-95d4-c53873e48b34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:21.178321 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5dfd56b5-3ec0-485d-95d4-c53873e48b34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:21.179465 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5dfd56b5-3ec0-485d-95d4-c53873e48b34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:21.180162 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5dfd56b5-3ec0-485d-95d4-c53873e48b34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:21.328664 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5dfd56b5-3ec0-485d-95d4-c53873e48b34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:21.340003 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5dfd56b5-3ec0-485d-95d4-c53873e48b34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.178988 Dec 15 14:14:21.341226 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 580/1167] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:21 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:21.838412 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c7df08a4-0393-4357-9067-a97c88073614 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:21.838942 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c7df08a4-0393-4357-9067-a97c88073614 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:21.846434 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7df08a4-0393-4357-9067-a97c88073614 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:21.846879 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7df08a4-0393-4357-9067-a97c88073614 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:21.847653 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7df08a4-0393-4357-9067-a97c88073614 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:21.848079 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7df08a4-0393-4357-9067-a97c88073614 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:21.989986 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c7df08a4-0393-4357-9067-a97c88073614 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:21.999027 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c7df08a4-0393-4357-9067-a97c88073614 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:22.000531 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c7df08a4-0393-4357-9067-a97c88073614 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:22.001741 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c7df08a4-0393-4357-9067-a97c88073614 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.167189 Dec 15 14:14:22.002384 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 588/1168] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:21 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:22.362684 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-218f23ba-7548-4534-aca3-13d88f710e76 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:22.363607 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-218f23ba-7548-4534-aca3-13d88f710e76 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:22.374429 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-218f23ba-7548-4534-aca3-13d88f710e76 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:22.374888 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-218f23ba-7548-4534-aca3-13d88f710e76 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:22.375670 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-218f23ba-7548-4534-aca3-13d88f710e76 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:22.376097 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-218f23ba-7548-4534-aca3-13d88f710e76 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:22.527047 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-218f23ba-7548-4534-aca3-13d88f710e76 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:22.535149 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-218f23ba-7548-4534-aca3-13d88f710e76 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.178804 Dec 15 14:14:22.535747 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 581/1169] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:22 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:23.025072 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2c2cf5b6-1a5c-4dff-bfe5-57874fce75ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:23.026085 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2c2cf5b6-1a5c-4dff-bfe5-57874fce75ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:23.034427 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2c2cf5b6-1a5c-4dff-bfe5-57874fce75ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:23.034879 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2c2cf5b6-1a5c-4dff-bfe5-57874fce75ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:23.035663 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2c2cf5b6-1a5c-4dff-bfe5-57874fce75ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:23.036101 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2c2cf5b6-1a5c-4dff-bfe5-57874fce75ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:23.183467 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2c2cf5b6-1a5c-4dff-bfe5-57874fce75ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:23.193640 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2c2cf5b6-1a5c-4dff-bfe5-57874fce75ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:23.195164 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2c2cf5b6-1a5c-4dff-bfe5-57874fce75ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:23.196342 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2c2cf5b6-1a5c-4dff-bfe5-57874fce75ab tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.178077 Dec 15 14:14:23.196914 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 589/1170] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:23 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:23.558352 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-170548b5-bb03-4570-886a-b00ed1b12355 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:23.559066 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-170548b5-bb03-4570-886a-b00ed1b12355 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:23.566860 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-170548b5-bb03-4570-886a-b00ed1b12355 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:23.567390 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-170548b5-bb03-4570-886a-b00ed1b12355 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:23.568311 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-170548b5-bb03-4570-886a-b00ed1b12355 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:23.568819 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-170548b5-bb03-4570-886a-b00ed1b12355 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:23.711871 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-170548b5-bb03-4570-886a-b00ed1b12355 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:23.720143 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-170548b5-bb03-4570-886a-b00ed1b12355 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.166261 Dec 15 14:14:23.720743 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 582/1171] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:23 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:24.226078 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-becd4bfe-c41d-4c3c-9b04-f38e4eef159c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:24.226966 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-becd4bfe-c41d-4c3c-9b04-f38e4eef159c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:24.237266 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-becd4bfe-c41d-4c3c-9b04-f38e4eef159c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:24.237744 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-becd4bfe-c41d-4c3c-9b04-f38e4eef159c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:24.238539 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-becd4bfe-c41d-4c3c-9b04-f38e4eef159c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:24.238968 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-becd4bfe-c41d-4c3c-9b04-f38e4eef159c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:24.383409 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-becd4bfe-c41d-4c3c-9b04-f38e4eef159c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:24.392295 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-becd4bfe-c41d-4c3c-9b04-f38e4eef159c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:24.394063 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-becd4bfe-c41d-4c3c-9b04-f38e4eef159c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:24.395252 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-becd4bfe-c41d-4c3c-9b04-f38e4eef159c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.175947 Dec 15 14:14:24.395833 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 590/1172] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:24 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:24.739757 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-eb146cb4-e971-45f1-8260-becbc6e5edf6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:24.740733 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-eb146cb4-e971-45f1-8260-becbc6e5edf6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:24.751045 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eb146cb4-e971-45f1-8260-becbc6e5edf6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:24.751879 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eb146cb4-e971-45f1-8260-becbc6e5edf6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:24.752824 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eb146cb4-e971-45f1-8260-becbc6e5edf6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:24.753250 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eb146cb4-e971-45f1-8260-becbc6e5edf6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:24.896196 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-eb146cb4-e971-45f1-8260-becbc6e5edf6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:24.904149 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-eb146cb4-e971-45f1-8260-becbc6e5edf6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.170570 Dec 15 14:14:24.904737 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 583/1173] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:24 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:24.978888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c7333afa-55f4-496d-adea-2f70037453db tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:24.979478 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c7333afa-55f4-496d-adea-2f70037453db tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:24.987935 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7333afa-55f4-496d-adea-2f70037453db tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:24.988388 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7333afa-55f4-496d-adea-2f70037453db tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:24.989169 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7333afa-55f4-496d-adea-2f70037453db tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:24.989637 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7333afa-55f4-496d-adea-2f70037453db tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:25.086853 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-c7333afa-55f4-496d-adea-2f70037453db tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lazy-loading 'services' on Instance uuid 95358386-841b-4e1b-9d6b-8fdc3751799f {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:14:25.162244 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c7333afa-55f4-496d-adea-2f70037453db tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "DELETE /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f/os-volume_attachments/3e7f7cf5-f022-4732-950c-08088a47aae0" status: 202 len: 0 microversion: 2.1 time: 0.189242 Dec 15 14:14:25.162861 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 591/1174] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Dec 15 14:14:24 2021] DELETE /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f/os-volume_attachments/3e7f7cf5-f022-4732-950c-08088a47aae0 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:25.414393 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4dd8a9ae-81c8-43b0-ae78-9f67f2d848ae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:25.414997 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4dd8a9ae-81c8-43b0-ae78-9f67f2d848ae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:25.421347 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4dd8a9ae-81c8-43b0-ae78-9f67f2d848ae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:25.421832 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4dd8a9ae-81c8-43b0-ae78-9f67f2d848ae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:25.422596 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4dd8a9ae-81c8-43b0-ae78-9f67f2d848ae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:25.423025 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4dd8a9ae-81c8-43b0-ae78-9f67f2d848ae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:25.570454 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4dd8a9ae-81c8-43b0-ae78-9f67f2d848ae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:25.582378 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4dd8a9ae-81c8-43b0-ae78-9f67f2d848ae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:25.583847 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4dd8a9ae-81c8-43b0-ae78-9f67f2d848ae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:25.585008 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4dd8a9ae-81c8-43b0-ae78-9f67f2d848ae tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.174345 Dec 15 14:14:25.585558 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 584/1175] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:25 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:25.923202 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-15960416-3cbf-4b76-81cc-ff653b5bc47e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:25.924081 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-15960416-3cbf-4b76-81cc-ff653b5bc47e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:25.930446 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15960416-3cbf-4b76-81cc-ff653b5bc47e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:25.930900 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15960416-3cbf-4b76-81cc-ff653b5bc47e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:25.931719 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15960416-3cbf-4b76-81cc-ff653b5bc47e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:25.932139 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15960416-3cbf-4b76-81cc-ff653b5bc47e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:26.078693 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-15960416-3cbf-4b76-81cc-ff653b5bc47e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:26.086449 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-15960416-3cbf-4b76-81cc-ff653b5bc47e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.167852 Dec 15 14:14:26.087014 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 592/1176] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:25 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:26.603817 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7695e868-0f19-4a6e-b9ea-287698b6ef72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:26.604433 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7695e868-0f19-4a6e-b9ea-287698b6ef72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:26.611359 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7695e868-0f19-4a6e-b9ea-287698b6ef72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:26.612081 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7695e868-0f19-4a6e-b9ea-287698b6ef72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:26.612986 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7695e868-0f19-4a6e-b9ea-287698b6ef72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:26.613425 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7695e868-0f19-4a6e-b9ea-287698b6ef72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:26.765071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7695e868-0f19-4a6e-b9ea-287698b6ef72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:26.775179 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7695e868-0f19-4a6e-b9ea-287698b6ef72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:26.776732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7695e868-0f19-4a6e-b9ea-287698b6ef72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:26.777966 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7695e868-0f19-4a6e-b9ea-287698b6ef72 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.178081 Dec 15 14:14:26.779003 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 585/1177] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:26 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:27.106865 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-93937a71-3670-487f-932b-119b3305fe9b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:27.107737 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-93937a71-3670-487f-932b-119b3305fe9b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:27.115719 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93937a71-3670-487f-932b-119b3305fe9b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:27.116164 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93937a71-3670-487f-932b-119b3305fe9b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:27.116963 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93937a71-3670-487f-932b-119b3305fe9b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:27.117400 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93937a71-3670-487f-932b-119b3305fe9b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:27.272751 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-93937a71-3670-487f-932b-119b3305fe9b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:27.285024 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-93937a71-3670-487f-932b-119b3305fe9b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.183424 Dec 15 14:14:27.285846 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 593/1178] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:27 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:27.797658 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2700ca21-c34f-4e1b-b374-3860d18741b3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:27.798280 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2700ca21-c34f-4e1b-b374-3860d18741b3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:27.805403 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2700ca21-c34f-4e1b-b374-3860d18741b3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:27.805883 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2700ca21-c34f-4e1b-b374-3860d18741b3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:27.806650 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2700ca21-c34f-4e1b-b374-3860d18741b3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:27.807557 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2700ca21-c34f-4e1b-b374-3860d18741b3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:27.944633 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2700ca21-c34f-4e1b-b374-3860d18741b3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:27.957051 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2700ca21-c34f-4e1b-b374-3860d18741b3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:27.958568 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2700ca21-c34f-4e1b-b374-3860d18741b3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:27.959758 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2700ca21-c34f-4e1b-b374-3860d18741b3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.165986 Dec 15 14:14:27.960311 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 586/1179] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:27 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:28.307429 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-94136a61-2746-402a-8999-afc3e1cd358d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:28.308047 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-94136a61-2746-402a-8999-afc3e1cd358d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:28.314892 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-94136a61-2746-402a-8999-afc3e1cd358d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:28.315448 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-94136a61-2746-402a-8999-afc3e1cd358d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:28.316227 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-94136a61-2746-402a-8999-afc3e1cd358d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:28.316693 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-94136a61-2746-402a-8999-afc3e1cd358d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:28.786076 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-94136a61-2746-402a-8999-afc3e1cd358d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:28.793678 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-94136a61-2746-402a-8999-afc3e1cd358d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.490049 Dec 15 14:14:28.794312 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 594/1180] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:28 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:28.979957 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e71951fa-d476-4406-9891-0d39d0555718 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:28.980563 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e71951fa-d476-4406-9891-0d39d0555718 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:28.987621 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e71951fa-d476-4406-9891-0d39d0555718 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:28.988179 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e71951fa-d476-4406-9891-0d39d0555718 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:28.988971 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e71951fa-d476-4406-9891-0d39d0555718 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:28.989407 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e71951fa-d476-4406-9891-0d39d0555718 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:29.195239 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e71951fa-d476-4406-9891-0d39d0555718 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:29.203895 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e71951fa-d476-4406-9891-0d39d0555718 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:29.205586 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e71951fa-d476-4406-9891-0d39d0555718 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:29.206987 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e71951fa-d476-4406-9891-0d39d0555718 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.230911 Dec 15 14:14:29.207810 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 587/1181] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:28 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:29.814350 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-51c38cc9-7b45-482a-abff-33864419429f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:29.815250 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-51c38cc9-7b45-482a-abff-33864419429f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:29.822960 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51c38cc9-7b45-482a-abff-33864419429f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:29.823406 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51c38cc9-7b45-482a-abff-33864419429f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:29.824189 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51c38cc9-7b45-482a-abff-33864419429f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:29.824626 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51c38cc9-7b45-482a-abff-33864419429f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:29.982404 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-51c38cc9-7b45-482a-abff-33864419429f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:29.994577 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-51c38cc9-7b45-482a-abff-33864419429f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.185902 Dec 15 14:14:29.995296 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 595/1182] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:29 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:30.230856 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-90a32642-64ae-4088-9e11-a2956a4d5451 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:30.231768 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-90a32642-64ae-4088-9e11-a2956a4d5451 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:30.241433 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90a32642-64ae-4088-9e11-a2956a4d5451 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:30.241904 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90a32642-64ae-4088-9e11-a2956a4d5451 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:30.242676 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90a32642-64ae-4088-9e11-a2956a4d5451 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:30.243102 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90a32642-64ae-4088-9e11-a2956a4d5451 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:30.377502 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-90a32642-64ae-4088-9e11-a2956a4d5451 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:30.386315 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-90a32642-64ae-4088-9e11-a2956a4d5451 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:30.387790 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-90a32642-64ae-4088-9e11-a2956a4d5451 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:30.388947 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-90a32642-64ae-4088-9e11-a2956a4d5451 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.164531 Dec 15 14:14:30.389471 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 588/1183] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:30 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:14:31.013488 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3e389a03-68f3-4e48-98e5-aaa9242f6bc4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:31.014259 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3e389a03-68f3-4e48-98e5-aaa9242f6bc4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:31.022007 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e389a03-68f3-4e48-98e5-aaa9242f6bc4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:31.022470 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e389a03-68f3-4e48-98e5-aaa9242f6bc4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:31.023223 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e389a03-68f3-4e48-98e5-aaa9242f6bc4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:31.023649 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e389a03-68f3-4e48-98e5-aaa9242f6bc4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:31.180373 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3e389a03-68f3-4e48-98e5-aaa9242f6bc4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:31.192335 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3e389a03-68f3-4e48-98e5-aaa9242f6bc4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.183259 Dec 15 14:14:31.192909 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 596/1184] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:31 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:31.415339 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e8410fb9-30dd-4dd4-8cd8-ddb225fcc4d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:31.416021 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e8410fb9-30dd-4dd4-8cd8-ddb225fcc4d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:31.422945 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8410fb9-30dd-4dd4-8cd8-ddb225fcc4d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:31.423404 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8410fb9-30dd-4dd4-8cd8-ddb225fcc4d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:31.424188 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8410fb9-30dd-4dd4-8cd8-ddb225fcc4d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:31.424608 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8410fb9-30dd-4dd4-8cd8-ddb225fcc4d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:31.571896 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e8410fb9-30dd-4dd4-8cd8-ddb225fcc4d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:31.580328 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e8410fb9-30dd-4dd4-8cd8-ddb225fcc4d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:31.581922 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e8410fb9-30dd-4dd4-8cd8-ddb225fcc4d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:31.583010 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e8410fb9-30dd-4dd4-8cd8-ddb225fcc4d7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.177707 Dec 15 14:14:31.583563 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 589/1185] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:31 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:32.219596 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-97fc20d2-0fc6-4713-8e85-01e6ad87dc88 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:32.220618 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-97fc20d2-0fc6-4713-8e85-01e6ad87dc88 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:32.228217 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97fc20d2-0fc6-4713-8e85-01e6ad87dc88 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:32.228711 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97fc20d2-0fc6-4713-8e85-01e6ad87dc88 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:32.229494 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97fc20d2-0fc6-4713-8e85-01e6ad87dc88 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:32.229957 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97fc20d2-0fc6-4713-8e85-01e6ad87dc88 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:32.375025 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-97fc20d2-0fc6-4713-8e85-01e6ad87dc88 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:32.383353 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-97fc20d2-0fc6-4713-8e85-01e6ad87dc88 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.171293 Dec 15 14:14:32.383977 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 597/1186] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:32 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:32.605557 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9c5e334b-e863-424d-855e-4506477b4756 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:32.606273 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9c5e334b-e863-424d-855e-4506477b4756 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:32.615755 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c5e334b-e863-424d-855e-4506477b4756 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:32.616206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c5e334b-e863-424d-855e-4506477b4756 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:32.616988 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c5e334b-e863-424d-855e-4506477b4756 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:32.617423 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c5e334b-e863-424d-855e-4506477b4756 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:32.763558 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9c5e334b-e863-424d-855e-4506477b4756 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:32.774571 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9c5e334b-e863-424d-855e-4506477b4756 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:32.776064 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9c5e334b-e863-424d-855e-4506477b4756 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:32.777355 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9c5e334b-e863-424d-855e-4506477b4756 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.178043 Dec 15 14:14:32.777958 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 590/1187] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:32 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:33.408780 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-baeb1c4f-dd4b-4b6e-a6b5-74190586998b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:33.409879 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-baeb1c4f-dd4b-4b6e-a6b5-74190586998b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:33.418496 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-baeb1c4f-dd4b-4b6e-a6b5-74190586998b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:33.418954 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-baeb1c4f-dd4b-4b6e-a6b5-74190586998b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:33.419787 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-baeb1c4f-dd4b-4b6e-a6b5-74190586998b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:33.420244 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-baeb1c4f-dd4b-4b6e-a6b5-74190586998b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:33.574015 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-baeb1c4f-dd4b-4b6e-a6b5-74190586998b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:33.585557 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-baeb1c4f-dd4b-4b6e-a6b5-74190586998b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.182893 Dec 15 14:14:33.586304 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 598/1188] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:33 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:33.796200 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-541e2d49-b5a4-4488-8411-5422679ad845 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:33.796888 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-541e2d49-b5a4-4488-8411-5422679ad845 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:33.804342 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-541e2d49-b5a4-4488-8411-5422679ad845 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:33.804824 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-541e2d49-b5a4-4488-8411-5422679ad845 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:33.805599 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-541e2d49-b5a4-4488-8411-5422679ad845 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:33.806076 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-541e2d49-b5a4-4488-8411-5422679ad845 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:33.947258 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-541e2d49-b5a4-4488-8411-5422679ad845 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:33.956022 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-541e2d49-b5a4-4488-8411-5422679ad845 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:33.957552 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-541e2d49-b5a4-4488-8411-5422679ad845 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:33.958774 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-541e2d49-b5a4-4488-8411-5422679ad845 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.166547 Dec 15 14:14:33.959343 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 591/1189] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:33 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:14:34.608067 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9b964a58-78cb-4ff3-9d61-bd55d71a22ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:34.608664 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9b964a58-78cb-4ff3-9d61-bd55d71a22ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:34.616288 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b964a58-78cb-4ff3-9d61-bd55d71a22ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:34.616733 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b964a58-78cb-4ff3-9d61-bd55d71a22ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:34.617515 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b964a58-78cb-4ff3-9d61-bd55d71a22ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:34.618004 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b964a58-78cb-4ff3-9d61-bd55d71a22ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:34.784867 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9b964a58-78cb-4ff3-9d61-bd55d71a22ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:34.796373 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9b964a58-78cb-4ff3-9d61-bd55d71a22ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.191783 Dec 15 14:14:34.797138 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 599/1190] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:34 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:34.982622 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-79af6e83-e2c0-4958-82a2-17000014372c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:34.983503 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-79af6e83-e2c0-4958-82a2-17000014372c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:34.995019 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-79af6e83-e2c0-4958-82a2-17000014372c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:34.995756 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-79af6e83-e2c0-4958-82a2-17000014372c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:34.997073 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-79af6e83-e2c0-4958-82a2-17000014372c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:34.997849 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-79af6e83-e2c0-4958-82a2-17000014372c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:35.150022 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-79af6e83-e2c0-4958-82a2-17000014372c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:35.163763 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-79af6e83-e2c0-4958-82a2-17000014372c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:35.165320 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-79af6e83-e2c0-4958-82a2-17000014372c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:35.166523 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-79af6e83-e2c0-4958-82a2-17000014372c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.190480 Dec 15 14:14:35.167089 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 592/1191] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:34 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:14:35.816600 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f9122c14-05a7-4327-b4fa-31da66bf74c6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:35.817170 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f9122c14-05a7-4327-b4fa-31da66bf74c6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:35.824502 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9122c14-05a7-4327-b4fa-31da66bf74c6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:35.824953 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9122c14-05a7-4327-b4fa-31da66bf74c6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:35.825795 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9122c14-05a7-4327-b4fa-31da66bf74c6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:35.826236 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9122c14-05a7-4327-b4fa-31da66bf74c6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:35.983819 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f9122c14-05a7-4327-b4fa-31da66bf74c6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:35.992343 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f9122c14-05a7-4327-b4fa-31da66bf74c6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.180157 Dec 15 14:14:35.992941 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 600/1192] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:35 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:36.188270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c65dfff3-f25a-46da-8537-0d584d57355c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:36.189239 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c65dfff3-f25a-46da-8537-0d584d57355c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:36.200082 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c65dfff3-f25a-46da-8537-0d584d57355c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:36.200832 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c65dfff3-f25a-46da-8537-0d584d57355c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:36.202185 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c65dfff3-f25a-46da-8537-0d584d57355c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:36.202916 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c65dfff3-f25a-46da-8537-0d584d57355c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:36.351113 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c65dfff3-f25a-46da-8537-0d584d57355c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:36.359994 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c65dfff3-f25a-46da-8537-0d584d57355c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:36.361481 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c65dfff3-f25a-46da-8537-0d584d57355c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:36.362675 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c65dfff3-f25a-46da-8537-0d584d57355c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.180805 Dec 15 14:14:36.363444 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 593/1193] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:36 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:37.016789 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fa16dc7d-f289-4887-8367-749912fd5ece tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:37.017833 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fa16dc7d-f289-4887-8367-749912fd5ece tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:37.026638 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa16dc7d-f289-4887-8367-749912fd5ece tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:37.027090 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa16dc7d-f289-4887-8367-749912fd5ece tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:37.027912 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa16dc7d-f289-4887-8367-749912fd5ece tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:37.028413 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa16dc7d-f289-4887-8367-749912fd5ece tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:37.182343 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fa16dc7d-f289-4887-8367-749912fd5ece tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:37.195107 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fa16dc7d-f289-4887-8367-749912fd5ece tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.184537 Dec 15 14:14:37.195676 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 601/1194] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:37 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:37.383346 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1c1ae4d7-b77f-4175-8a0f-11218b4021a7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:37.384057 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1c1ae4d7-b77f-4175-8a0f-11218b4021a7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:37.392789 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c1ae4d7-b77f-4175-8a0f-11218b4021a7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:37.393291 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c1ae4d7-b77f-4175-8a0f-11218b4021a7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:37.394328 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c1ae4d7-b77f-4175-8a0f-11218b4021a7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:37.394923 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c1ae4d7-b77f-4175-8a0f-11218b4021a7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:37.559168 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1c1ae4d7-b77f-4175-8a0f-11218b4021a7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:37.568299 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1c1ae4d7-b77f-4175-8a0f-11218b4021a7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:37.569828 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1c1ae4d7-b77f-4175-8a0f-11218b4021a7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:37.570998 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1c1ae4d7-b77f-4175-8a0f-11218b4021a7 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.192829 Dec 15 14:14:37.571555 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 594/1195] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:37 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:38.216099 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cc933db8-d5f9-4575-ab95-76dac5d3be89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:38.216870 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cc933db8-d5f9-4575-ab95-76dac5d3be89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:38.227600 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc933db8-d5f9-4575-ab95-76dac5d3be89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:38.228011 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc933db8-d5f9-4575-ab95-76dac5d3be89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:38.229346 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc933db8-d5f9-4575-ab95-76dac5d3be89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:38.229983 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc933db8-d5f9-4575-ab95-76dac5d3be89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:38.387410 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cc933db8-d5f9-4575-ab95-76dac5d3be89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:38.398661 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cc933db8-d5f9-4575-ab95-76dac5d3be89 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.189289 Dec 15 14:14:38.399227 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 602/1196] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:38 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:38.594113 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1b8fc4ae-b696-40bb-8bf3-df390b914c3f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:38.595112 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1b8fc4ae-b696-40bb-8bf3-df390b914c3f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:38.604437 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b8fc4ae-b696-40bb-8bf3-df390b914c3f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:38.604889 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b8fc4ae-b696-40bb-8bf3-df390b914c3f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:38.605695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b8fc4ae-b696-40bb-8bf3-df390b914c3f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:38.606139 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b8fc4ae-b696-40bb-8bf3-df390b914c3f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:38.747959 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1b8fc4ae-b696-40bb-8bf3-df390b914c3f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:38.756938 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1b8fc4ae-b696-40bb-8bf3-df390b914c3f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:38.759130 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1b8fc4ae-b696-40bb-8bf3-df390b914c3f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:38.760340 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1b8fc4ae-b696-40bb-8bf3-df390b914c3f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.173069 Dec 15 14:14:38.760906 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 595/1197] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:38 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:39.425156 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e5c4e969-4e87-4a54-91e0-8b7a0b618482 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:39.426224 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e5c4e969-4e87-4a54-91e0-8b7a0b618482 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:39.437374 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5c4e969-4e87-4a54-91e0-8b7a0b618482 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:39.438193 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5c4e969-4e87-4a54-91e0-8b7a0b618482 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:39.439604 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5c4e969-4e87-4a54-91e0-8b7a0b618482 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:39.440336 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5c4e969-4e87-4a54-91e0-8b7a0b618482 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:39.586890 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e5c4e969-4e87-4a54-91e0-8b7a0b618482 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:39.599085 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e5c4e969-4e87-4a54-91e0-8b7a0b618482 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.180286 Dec 15 14:14:39.599957 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 603/1198] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:39 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:39.780698 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f3fbe5e9-163b-46c2-9c53-20faf81dae1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:39.781326 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f3fbe5e9-163b-46c2-9c53-20faf81dae1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:39.791300 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f3fbe5e9-163b-46c2-9c53-20faf81dae1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:39.791755 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f3fbe5e9-163b-46c2-9c53-20faf81dae1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:39.792549 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f3fbe5e9-163b-46c2-9c53-20faf81dae1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:39.793166 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f3fbe5e9-163b-46c2-9c53-20faf81dae1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:39.949074 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f3fbe5e9-163b-46c2-9c53-20faf81dae1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:39.957962 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f3fbe5e9-163b-46c2-9c53-20faf81dae1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:39.959467 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f3fbe5e9-163b-46c2-9c53-20faf81dae1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:39.960706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f3fbe5e9-163b-46c2-9c53-20faf81dae1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.184260 Dec 15 14:14:39.961271 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 596/1199] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:39 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:40.623093 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a5f40d36-aef2-4a4e-988b-341f5b1b1921 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:40.623684 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a5f40d36-aef2-4a4e-988b-341f5b1b1921 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:40.630824 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5f40d36-aef2-4a4e-988b-341f5b1b1921 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:40.631296 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5f40d36-aef2-4a4e-988b-341f5b1b1921 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:40.632461 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5f40d36-aef2-4a4e-988b-341f5b1b1921 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:40.632939 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5f40d36-aef2-4a4e-988b-341f5b1b1921 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:40.777581 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a5f40d36-aef2-4a4e-988b-341f5b1b1921 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:40.789699 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a5f40d36-aef2-4a4e-988b-341f5b1b1921 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.170154 Dec 15 14:14:40.790635 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 604/1200] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:40 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:40.990036 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-66fe0752-edcc-48c1-ad6c-21fd57770316 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:40.990877 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-66fe0752-edcc-48c1-ad6c-21fd57770316 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:41.001902 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66fe0752-edcc-48c1-ad6c-21fd57770316 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:41.002650 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66fe0752-edcc-48c1-ad6c-21fd57770316 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:41.003930 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66fe0752-edcc-48c1-ad6c-21fd57770316 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:41.004656 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66fe0752-edcc-48c1-ad6c-21fd57770316 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:41.166241 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-66fe0752-edcc-48c1-ad6c-21fd57770316 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:41.175706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-66fe0752-edcc-48c1-ad6c-21fd57770316 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:41.177224 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-66fe0752-edcc-48c1-ad6c-21fd57770316 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:41.178688 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-66fe0752-edcc-48c1-ad6c-21fd57770316 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.194812 Dec 15 14:14:41.179882 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 597/1201] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:40 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:41.807876 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f1f24edb-927a-4c96-96fe-2a7993bd0ab2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:41.808477 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f1f24edb-927a-4c96-96fe-2a7993bd0ab2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:41.815554 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f1f24edb-927a-4c96-96fe-2a7993bd0ab2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:41.816003 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f1f24edb-927a-4c96-96fe-2a7993bd0ab2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:41.816788 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f1f24edb-927a-4c96-96fe-2a7993bd0ab2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:41.817201 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f1f24edb-927a-4c96-96fe-2a7993bd0ab2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:42.007721 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f1f24edb-927a-4c96-96fe-2a7993bd0ab2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:42.019041 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f1f24edb-927a-4c96-96fe-2a7993bd0ab2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.214790 Dec 15 14:14:42.019810 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 605/1202] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:41 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:42.208664 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-92683589-0fb8-407c-a14e-d5cecabbf21d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:42.209589 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-92683589-0fb8-407c-a14e-d5cecabbf21d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:42.217182 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-92683589-0fb8-407c-a14e-d5cecabbf21d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:42.217639 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-92683589-0fb8-407c-a14e-d5cecabbf21d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:42.218444 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-92683589-0fb8-407c-a14e-d5cecabbf21d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:42.218881 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-92683589-0fb8-407c-a14e-d5cecabbf21d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:42.359455 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-92683589-0fb8-407c-a14e-d5cecabbf21d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:42.369253 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-92683589-0fb8-407c-a14e-d5cecabbf21d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:42.370791 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-92683589-0fb8-407c-a14e-d5cecabbf21d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:42.371961 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-92683589-0fb8-407c-a14e-d5cecabbf21d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.169648 Dec 15 14:14:42.372523 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 598/1203] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:42 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:43.042604 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-86d12939-24a2-4da7-a6b8-b7c6da4ed8d9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:43.043674 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-86d12939-24a2-4da7-a6b8-b7c6da4ed8d9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:43.054622 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86d12939-24a2-4da7-a6b8-b7c6da4ed8d9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:43.055105 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86d12939-24a2-4da7-a6b8-b7c6da4ed8d9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:43.055901 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86d12939-24a2-4da7-a6b8-b7c6da4ed8d9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:43.056406 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86d12939-24a2-4da7-a6b8-b7c6da4ed8d9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:43.208544 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-86d12939-24a2-4da7-a6b8-b7c6da4ed8d9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:43.216930 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-86d12939-24a2-4da7-a6b8-b7c6da4ed8d9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.181438 Dec 15 14:14:43.217512 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 606/1204] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:43 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:43.394974 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-63ac043c-f518-41f0-a859-9fa1bb634c1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:43.396058 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-63ac043c-f518-41f0-a859-9fa1bb634c1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:43.406699 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-63ac043c-f518-41f0-a859-9fa1bb634c1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:43.407467 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-63ac043c-f518-41f0-a859-9fa1bb634c1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:43.408763 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-63ac043c-f518-41f0-a859-9fa1bb634c1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:43.409567 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-63ac043c-f518-41f0-a859-9fa1bb634c1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:43.546151 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-63ac043c-f518-41f0-a859-9fa1bb634c1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:43.554577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-63ac043c-f518-41f0-a859-9fa1bb634c1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:43.556066 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-63ac043c-f518-41f0-a859-9fa1bb634c1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:43.557212 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-63ac043c-f518-41f0-a859-9fa1bb634c1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.168606 Dec 15 14:14:43.557806 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 599/1205] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:43 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:44.239013 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-09f76f38-0b05-424a-b879-d86a164e49b3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:44.239952 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-09f76f38-0b05-424a-b879-d86a164e49b3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:44.247731 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-09f76f38-0b05-424a-b879-d86a164e49b3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:44.248177 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-09f76f38-0b05-424a-b879-d86a164e49b3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:44.248949 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-09f76f38-0b05-424a-b879-d86a164e49b3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:44.249378 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-09f76f38-0b05-424a-b879-d86a164e49b3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:44.399283 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-09f76f38-0b05-424a-b879-d86a164e49b3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:44.406970 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-09f76f38-0b05-424a-b879-d86a164e49b3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.174267 Dec 15 14:14:44.407540 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 607/1206] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:44 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:44.577795 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b5fc2151-4ba2-422b-8c73-9b8871efcf93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:44.578515 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b5fc2151-4ba2-422b-8c73-9b8871efcf93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:44.587845 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5fc2151-4ba2-422b-8c73-9b8871efcf93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:44.588391 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5fc2151-4ba2-422b-8c73-9b8871efcf93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:44.589390 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5fc2151-4ba2-422b-8c73-9b8871efcf93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:44.590304 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5fc2151-4ba2-422b-8c73-9b8871efcf93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:44.736616 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b5fc2151-4ba2-422b-8c73-9b8871efcf93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:44.745491 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b5fc2151-4ba2-422b-8c73-9b8871efcf93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:44.747019 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b5fc2151-4ba2-422b-8c73-9b8871efcf93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:44.748173 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b5fc2151-4ba2-422b-8c73-9b8871efcf93 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.175183 Dec 15 14:14:44.748719 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 600/1207] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:44 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:45.428232 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-83a4c62e-f191-45c2-a1b5-dd3432fc33dc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:45.429193 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-83a4c62e-f191-45c2-a1b5-dd3432fc33dc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:45.440773 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83a4c62e-f191-45c2-a1b5-dd3432fc33dc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:45.441502 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83a4c62e-f191-45c2-a1b5-dd3432fc33dc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:45.442874 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83a4c62e-f191-45c2-a1b5-dd3432fc33dc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:45.443594 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83a4c62e-f191-45c2-a1b5-dd3432fc33dc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:45.588409 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-83a4c62e-f191-45c2-a1b5-dd3432fc33dc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:45.601301 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-83a4c62e-f191-45c2-a1b5-dd3432fc33dc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.178964 Dec 15 14:14:45.601936 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 608/1208] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:45 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:45.770674 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bdbdbd92-54ab-4690-b666-2deb2cd93a2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:45.771535 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bdbdbd92-54ab-4690-b666-2deb2cd93a2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:45.779237 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bdbdbd92-54ab-4690-b666-2deb2cd93a2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:45.779685 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bdbdbd92-54ab-4690-b666-2deb2cd93a2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:45.780485 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bdbdbd92-54ab-4690-b666-2deb2cd93a2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:45.780952 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bdbdbd92-54ab-4690-b666-2deb2cd93a2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:45.924229 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bdbdbd92-54ab-4690-b666-2deb2cd93a2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:45.933807 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bdbdbd92-54ab-4690-b666-2deb2cd93a2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:45.935288 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bdbdbd92-54ab-4690-b666-2deb2cd93a2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:45.936445 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bdbdbd92-54ab-4690-b666-2deb2cd93a2e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.172339 Dec 15 14:14:45.936993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 601/1209] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:45 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:46.627657 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a48cae87-fe83-401f-9d03-927dd39a717e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:46.628469 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a48cae87-fe83-401f-9d03-927dd39a717e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:46.638999 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a48cae87-fe83-401f-9d03-927dd39a717e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:46.639695 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a48cae87-fe83-401f-9d03-927dd39a717e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:46.640879 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a48cae87-fe83-401f-9d03-927dd39a717e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:46.641564 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a48cae87-fe83-401f-9d03-927dd39a717e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:46.786988 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a48cae87-fe83-401f-9d03-927dd39a717e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:46.794995 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a48cae87-fe83-401f-9d03-927dd39a717e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.173873 Dec 15 14:14:46.795574 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 609/1210] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:46 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:46.959553 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b2871b73-fa0b-4139-90be-c968e82c0d7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:46.960404 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b2871b73-fa0b-4139-90be-c968e82c0d7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:46.971801 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b2871b73-fa0b-4139-90be-c968e82c0d7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:46.972530 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b2871b73-fa0b-4139-90be-c968e82c0d7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:46.973864 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b2871b73-fa0b-4139-90be-c968e82c0d7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:46.974567 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b2871b73-fa0b-4139-90be-c968e82c0d7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:47.126735 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b2871b73-fa0b-4139-90be-c968e82c0d7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:47.136074 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b2871b73-fa0b-4139-90be-c968e82c0d7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:47.137555 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b2871b73-fa0b-4139-90be-c968e82c0d7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:47.138776 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b2871b73-fa0b-4139-90be-c968e82c0d7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.185784 Dec 15 14:14:47.139398 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 602/1211] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:46 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:47.812685 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a3b5e878-95b7-4d1a-a749-debfd7135c61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:47.813311 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a3b5e878-95b7-4d1a-a749-debfd7135c61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:47.820371 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3b5e878-95b7-4d1a-a749-debfd7135c61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:47.820824 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3b5e878-95b7-4d1a-a749-debfd7135c61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:47.821644 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3b5e878-95b7-4d1a-a749-debfd7135c61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:47.822226 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3b5e878-95b7-4d1a-a749-debfd7135c61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:47.974029 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a3b5e878-95b7-4d1a-a749-debfd7135c61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:47.983013 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a3b5e878-95b7-4d1a-a749-debfd7135c61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.174157 Dec 15 14:14:47.983591 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 610/1212] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:47 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:48.162241 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-655eea16-589f-4dfe-aa39-46c1364dfb04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:48.163284 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-655eea16-589f-4dfe-aa39-46c1364dfb04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:48.174299 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-655eea16-589f-4dfe-aa39-46c1364dfb04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:48.175042 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-655eea16-589f-4dfe-aa39-46c1364dfb04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:48.176306 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-655eea16-589f-4dfe-aa39-46c1364dfb04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:48.177016 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-655eea16-589f-4dfe-aa39-46c1364dfb04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:48.334105 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-655eea16-589f-4dfe-aa39-46c1364dfb04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:48.347577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-655eea16-589f-4dfe-aa39-46c1364dfb04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:48.349926 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-655eea16-589f-4dfe-aa39-46c1364dfb04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:48.351772 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-655eea16-589f-4dfe-aa39-46c1364dfb04 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.195676 Dec 15 14:14:48.352546 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 603/1213] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:48 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:49.007399 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f7bc3191-4e24-48e0-85ee-657de9f03e43 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:49.008412 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f7bc3191-4e24-48e0-85ee-657de9f03e43 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:49.019483 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7bc3191-4e24-48e0-85ee-657de9f03e43 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:49.020339 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7bc3191-4e24-48e0-85ee-657de9f03e43 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:49.021654 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7bc3191-4e24-48e0-85ee-657de9f03e43 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:49.022435 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7bc3191-4e24-48e0-85ee-657de9f03e43 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:49.166774 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f7bc3191-4e24-48e0-85ee-657de9f03e43 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:49.175104 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f7bc3191-4e24-48e0-85ee-657de9f03e43 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.174016 Dec 15 14:14:49.175684 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 611/1214] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:48 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:49.380272 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0c757ecc-f88a-4c6a-840d-8034c834dc7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:49.381247 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0c757ecc-f88a-4c6a-840d-8034c834dc7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:49.389127 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0c757ecc-f88a-4c6a-840d-8034c834dc7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:49.389554 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0c757ecc-f88a-4c6a-840d-8034c834dc7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:49.390371 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0c757ecc-f88a-4c6a-840d-8034c834dc7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:49.390810 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0c757ecc-f88a-4c6a-840d-8034c834dc7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:49.538980 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0c757ecc-f88a-4c6a-840d-8034c834dc7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:49.548062 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0c757ecc-f88a-4c6a-840d-8034c834dc7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:49.549558 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0c757ecc-f88a-4c6a-840d-8034c834dc7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:49.550750 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0c757ecc-f88a-4c6a-840d-8034c834dc7f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.177603 Dec 15 14:14:49.551356 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 604/1215] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:49 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:50.197210 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-114d66b6-c0a2-4ab4-91e4-99ad7c3c3843 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:50.198207 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-114d66b6-c0a2-4ab4-91e4-99ad7c3c3843 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:50.209132 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-114d66b6-c0a2-4ab4-91e4-99ad7c3c3843 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:50.209953 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-114d66b6-c0a2-4ab4-91e4-99ad7c3c3843 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:50.211254 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-114d66b6-c0a2-4ab4-91e4-99ad7c3c3843 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:50.212129 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-114d66b6-c0a2-4ab4-91e4-99ad7c3c3843 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:50.372758 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-114d66b6-c0a2-4ab4-91e4-99ad7c3c3843 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:50.384595 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-114d66b6-c0a2-4ab4-91e4-99ad7c3c3843 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.193754 Dec 15 14:14:50.385368 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 612/1216] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:50 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:50.572552 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5291d83d-a81c-4792-bf78-c786de44aa1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:50.573110 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5291d83d-a81c-4792-bf78-c786de44aa1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:50.579868 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5291d83d-a81c-4792-bf78-c786de44aa1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:50.580311 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5291d83d-a81c-4792-bf78-c786de44aa1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:50.581086 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5291d83d-a81c-4792-bf78-c786de44aa1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:50.581518 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5291d83d-a81c-4792-bf78-c786de44aa1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:50.727890 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5291d83d-a81c-4792-bf78-c786de44aa1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:50.736938 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5291d83d-a81c-4792-bf78-c786de44aa1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:50.738461 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5291d83d-a81c-4792-bf78-c786de44aa1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:50.739629 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5291d83d-a81c-4792-bf78-c786de44aa1c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.172678 Dec 15 14:14:50.740217 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 605/1217] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:50 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:51.408137 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-56aeddd6-68af-4464-934b-9b17b1193ef6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:51.408775 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-56aeddd6-68af-4464-934b-9b17b1193ef6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:51.415764 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56aeddd6-68af-4464-934b-9b17b1193ef6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:51.416298 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56aeddd6-68af-4464-934b-9b17b1193ef6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:51.417152 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56aeddd6-68af-4464-934b-9b17b1193ef6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:51.418221 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56aeddd6-68af-4464-934b-9b17b1193ef6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:51.558911 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-56aeddd6-68af-4464-934b-9b17b1193ef6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:51.567255 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-56aeddd6-68af-4464-934b-9b17b1193ef6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.163259 Dec 15 14:14:51.567871 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 613/1218] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:51 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:51.762108 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-af12bdc1-bddd-47ad-9430-2f26d8787c95 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:51.763144 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-af12bdc1-bddd-47ad-9430-2f26d8787c95 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:51.773332 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-af12bdc1-bddd-47ad-9430-2f26d8787c95 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:51.774121 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-af12bdc1-bddd-47ad-9430-2f26d8787c95 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:51.775283 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-af12bdc1-bddd-47ad-9430-2f26d8787c95 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:51.775690 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-af12bdc1-bddd-47ad-9430-2f26d8787c95 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:51.915279 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-af12bdc1-bddd-47ad-9430-2f26d8787c95 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:51.928094 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-af12bdc1-bddd-47ad-9430-2f26d8787c95 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:51.930432 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-af12bdc1-bddd-47ad-9430-2f26d8787c95 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:51.931822 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-af12bdc1-bddd-47ad-9430-2f26d8787c95 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.176386 Dec 15 14:14:51.932384 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 606/1219] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:51 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:52.588121 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dd1d5d92-87d5-4e44-95b6-b5ba28be1228 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:52.588758 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dd1d5d92-87d5-4e44-95b6-b5ba28be1228 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:52.595840 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd1d5d92-87d5-4e44-95b6-b5ba28be1228 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:52.596298 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd1d5d92-87d5-4e44-95b6-b5ba28be1228 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:52.597086 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd1d5d92-87d5-4e44-95b6-b5ba28be1228 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:52.597524 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd1d5d92-87d5-4e44-95b6-b5ba28be1228 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:52.743056 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dd1d5d92-87d5-4e44-95b6-b5ba28be1228 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:52.751350 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dd1d5d92-87d5-4e44-95b6-b5ba28be1228 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.169480 Dec 15 14:14:52.751918 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 614/1220] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:52 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:52.955105 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ac741b5a-94d8-43ec-b1aa-9fb26e76c9af tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:52.956040 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ac741b5a-94d8-43ec-b1aa-9fb26e76c9af tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:52.967831 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac741b5a-94d8-43ec-b1aa-9fb26e76c9af tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:52.968577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac741b5a-94d8-43ec-b1aa-9fb26e76c9af tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:52.969925 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac741b5a-94d8-43ec-b1aa-9fb26e76c9af tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:52.970646 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac741b5a-94d8-43ec-b1aa-9fb26e76c9af tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:53.122512 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ac741b5a-94d8-43ec-b1aa-9fb26e76c9af tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:53.131506 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ac741b5a-94d8-43ec-b1aa-9fb26e76c9af tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:53.133015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ac741b5a-94d8-43ec-b1aa-9fb26e76c9af tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:53.134522 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ac741b5a-94d8-43ec-b1aa-9fb26e76c9af tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.185883 Dec 15 14:14:53.135164 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 607/1221] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:52 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:53.773150 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e3025a30-5568-44eb-bc01-73a9f52e1571 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:53.775259 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e3025a30-5568-44eb-bc01-73a9f52e1571 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:53.786106 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e3025a30-5568-44eb-bc01-73a9f52e1571 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:53.786841 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e3025a30-5568-44eb-bc01-73a9f52e1571 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:53.788126 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e3025a30-5568-44eb-bc01-73a9f52e1571 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:53.788818 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e3025a30-5568-44eb-bc01-73a9f52e1571 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:53.939021 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e3025a30-5568-44eb-bc01-73a9f52e1571 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:53.947610 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e3025a30-5568-44eb-bc01-73a9f52e1571 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.180724 Dec 15 14:14:53.948632 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 615/1222] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:53 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:54.154058 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6cabb1d5-4768-4d9e-bac5-0f0555c25319 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:54.154783 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6cabb1d5-4768-4d9e-bac5-0f0555c25319 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:54.162685 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6cabb1d5-4768-4d9e-bac5-0f0555c25319 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:54.163206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6cabb1d5-4768-4d9e-bac5-0f0555c25319 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:54.164119 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6cabb1d5-4768-4d9e-bac5-0f0555c25319 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:54.164626 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6cabb1d5-4768-4d9e-bac5-0f0555c25319 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:54.310538 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6cabb1d5-4768-4d9e-bac5-0f0555c25319 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:54.319652 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6cabb1d5-4768-4d9e-bac5-0f0555c25319 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:54.321143 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6cabb1d5-4768-4d9e-bac5-0f0555c25319 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:54.322380 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6cabb1d5-4768-4d9e-bac5-0f0555c25319 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.173363 Dec 15 14:14:54.322946 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 608/1223] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:54 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:54.970773 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-74c6ddda-b183-46a9-aa47-d403f2402010 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:54.971761 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-74c6ddda-b183-46a9-aa47-d403f2402010 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:54.982799 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74c6ddda-b183-46a9-aa47-d403f2402010 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:54.983352 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74c6ddda-b183-46a9-aa47-d403f2402010 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:54.984140 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74c6ddda-b183-46a9-aa47-d403f2402010 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:54.984579 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74c6ddda-b183-46a9-aa47-d403f2402010 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:55.133997 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-74c6ddda-b183-46a9-aa47-d403f2402010 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:55.142973 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-74c6ddda-b183-46a9-aa47-d403f2402010 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.179814 Dec 15 14:14:55.143535 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 616/1224] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:54 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:55.344102 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1bed0900-968d-491d-bfcb-8438e8bd40c0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:55.344844 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1bed0900-968d-491d-bfcb-8438e8bd40c0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:55.352938 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1bed0900-968d-491d-bfcb-8438e8bd40c0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:55.353493 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1bed0900-968d-491d-bfcb-8438e8bd40c0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:55.354468 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1bed0900-968d-491d-bfcb-8438e8bd40c0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:55.354983 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1bed0900-968d-491d-bfcb-8438e8bd40c0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:55.517099 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1bed0900-968d-491d-bfcb-8438e8bd40c0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:55.529587 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1bed0900-968d-491d-bfcb-8438e8bd40c0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:55.531104 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1bed0900-968d-491d-bfcb-8438e8bd40c0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:55.532256 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1bed0900-968d-491d-bfcb-8438e8bd40c0 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.194044 Dec 15 14:14:55.532857 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 609/1225] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:55 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:56.169156 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b860d2f4-1ce2-4ac3-8e62-02de33f61709 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:56.170131 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b860d2f4-1ce2-4ac3-8e62-02de33f61709 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:56.180528 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b860d2f4-1ce2-4ac3-8e62-02de33f61709 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:56.181210 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b860d2f4-1ce2-4ac3-8e62-02de33f61709 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:56.182504 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b860d2f4-1ce2-4ac3-8e62-02de33f61709 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:56.183221 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b860d2f4-1ce2-4ac3-8e62-02de33f61709 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:56.330535 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b860d2f4-1ce2-4ac3-8e62-02de33f61709 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:56.338395 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b860d2f4-1ce2-4ac3-8e62-02de33f61709 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.175394 Dec 15 14:14:56.338967 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 617/1226] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:56 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:56.551410 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a28d05c8-6c72-418e-9d9c-b78c6c715b19 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:56.552014 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a28d05c8-6c72-418e-9d9c-b78c6c715b19 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:56.561521 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a28d05c8-6c72-418e-9d9c-b78c6c715b19 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:56.562229 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a28d05c8-6c72-418e-9d9c-b78c6c715b19 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:56.563499 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a28d05c8-6c72-418e-9d9c-b78c6c715b19 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:56.564231 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a28d05c8-6c72-418e-9d9c-b78c6c715b19 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:56.707602 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a28d05c8-6c72-418e-9d9c-b78c6c715b19 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:56.716900 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a28d05c8-6c72-418e-9d9c-b78c6c715b19 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:56.719018 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a28d05c8-6c72-418e-9d9c-b78c6c715b19 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:56.720185 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a28d05c8-6c72-418e-9d9c-b78c6c715b19 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 200 len: 1745 microversion: 2.20 time: 0.172952 Dec 15 14:14:56.720747 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 610/1227] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:56 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:14:57.359352 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9b076f92-fc39-4c11-9344-a1654c355079 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:57.359998 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9b076f92-fc39-4c11-9344-a1654c355079 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:57.367150 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b076f92-fc39-4c11-9344-a1654c355079 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:57.367648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b076f92-fc39-4c11-9344-a1654c355079 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:57.368472 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b076f92-fc39-4c11-9344-a1654c355079 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:57.368931 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b076f92-fc39-4c11-9344-a1654c355079 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:57.526619 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9b076f92-fc39-4c11-9344-a1654c355079 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:57.536582 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9b076f92-fc39-4c11-9344-a1654c355079 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.182888 Dec 15 14:14:57.537211 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 618/1228] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:57 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:58.555299 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5206442a-6df2-42d9-8ee0-d3bb3e67700c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:58.556010 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5206442a-6df2-42d9-8ee0-d3bb3e67700c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:58.563671 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5206442a-6df2-42d9-8ee0-d3bb3e67700c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:58.564110 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5206442a-6df2-42d9-8ee0-d3bb3e67700c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:58.564883 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5206442a-6df2-42d9-8ee0-d3bb3e67700c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:58.565308 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5206442a-6df2-42d9-8ee0-d3bb3e67700c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:58.718678 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5206442a-6df2-42d9-8ee0-d3bb3e67700c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:58.730540 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5206442a-6df2-42d9-8ee0-d3bb3e67700c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.178991 Dec 15 14:14:58.731308 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 611/1229] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:58 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:59.752204 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-10852a83-926d-4cff-bf04-a7354ea2eb73 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:59.752996 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-10852a83-926d-4cff-bf04-a7354ea2eb73 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:59.761894 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10852a83-926d-4cff-bf04-a7354ea2eb73 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:59.762500 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10852a83-926d-4cff-bf04-a7354ea2eb73 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:59.763550 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10852a83-926d-4cff-bf04-a7354ea2eb73 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:59.764136 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10852a83-926d-4cff-bf04-a7354ea2eb73 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:59.917126 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-10852a83-926d-4cff-bf04-a7354ea2eb73 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:59.925257 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-10852a83-926d-4cff-bf04-a7354ea2eb73 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.179011 Dec 15 14:14:59.925874 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 619/1230] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:59 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:00.945015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-92cb5f52-ca41-4e8d-8217-bec67dff18e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:00.945920 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-92cb5f52-ca41-4e8d-8217-bec67dff18e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:00.955316 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-92cb5f52-ca41-4e8d-8217-bec67dff18e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:00.955766 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-92cb5f52-ca41-4e8d-8217-bec67dff18e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:00.956540 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-92cb5f52-ca41-4e8d-8217-bec67dff18e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:00.956976 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-92cb5f52-ca41-4e8d-8217-bec67dff18e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:01.103536 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-92cb5f52-ca41-4e8d-8217-bec67dff18e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:01.111589 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-92cb5f52-ca41-4e8d-8217-bec67dff18e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.172105 Dec 15 14:15:01.112205 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 612/1231] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:00 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:02.131603 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-35122a81-d32c-4d8a-a2ad-c7e8ffcabadb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:02.132290 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-35122a81-d32c-4d8a-a2ad-c7e8ffcabadb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:02.140089 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35122a81-d32c-4d8a-a2ad-c7e8ffcabadb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:02.140614 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35122a81-d32c-4d8a-a2ad-c7e8ffcabadb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:02.141528 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35122a81-d32c-4d8a-a2ad-c7e8ffcabadb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:02.142095 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35122a81-d32c-4d8a-a2ad-c7e8ffcabadb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:02.295943 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-35122a81-d32c-4d8a-a2ad-c7e8ffcabadb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:02.303595 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-35122a81-d32c-4d8a-a2ad-c7e8ffcabadb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.177094 Dec 15 14:15:02.304180 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 620/1232] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:02 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:02.812824 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:15:02.813360 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:15:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:15:03.324769 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-636dc596-b0fe-42ff-9195-7c04e46c2908 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:03.325687 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-636dc596-b0fe-42ff-9195-7c04e46c2908 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:03.334662 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-636dc596-b0fe-42ff-9195-7c04e46c2908 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:03.335491 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-636dc596-b0fe-42ff-9195-7c04e46c2908 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:03.336824 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-636dc596-b0fe-42ff-9195-7c04e46c2908 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:03.337453 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-636dc596-b0fe-42ff-9195-7c04e46c2908 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:03.492737 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-636dc596-b0fe-42ff-9195-7c04e46c2908 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:03.500996 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-636dc596-b0fe-42ff-9195-7c04e46c2908 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.182651 Dec 15 14:15:03.501566 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 613/1233] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:03 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:04.521641 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-beb609e4-0b76-44c5-ad80-34e533818953 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:04.522249 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-beb609e4-0b76-44c5-ad80-34e533818953 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:04.529201 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-beb609e4-0b76-44c5-ad80-34e533818953 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:04.529659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-beb609e4-0b76-44c5-ad80-34e533818953 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:04.530484 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-beb609e4-0b76-44c5-ad80-34e533818953 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:04.530932 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-beb609e4-0b76-44c5-ad80-34e533818953 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:04.680627 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-beb609e4-0b76-44c5-ad80-34e533818953 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:04.691603 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-beb609e4-0b76-44c5-ad80-34e533818953 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.174437 Dec 15 14:15:04.692446 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 621/1234] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:04 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:05.710065 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-eaafca1b-4670-47bd-b193-3bfbfb8f5e58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:05.711400 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-eaafca1b-4670-47bd-b193-3bfbfb8f5e58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:05.719170 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eaafca1b-4670-47bd-b193-3bfbfb8f5e58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:05.720684 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eaafca1b-4670-47bd-b193-3bfbfb8f5e58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:05.722982 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eaafca1b-4670-47bd-b193-3bfbfb8f5e58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:05.724479 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eaafca1b-4670-47bd-b193-3bfbfb8f5e58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:05.903636 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-eaafca1b-4670-47bd-b193-3bfbfb8f5e58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:05.916713 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-eaafca1b-4670-47bd-b193-3bfbfb8f5e58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.210523 Dec 15 14:15:05.917270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 614/1235] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:05 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:06.937656 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dadd9790-38b3-49bb-a32a-4422cea8a03b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:06.938238 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dadd9790-38b3-49bb-a32a-4422cea8a03b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:06.948781 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dadd9790-38b3-49bb-a32a-4422cea8a03b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:06.949365 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dadd9790-38b3-49bb-a32a-4422cea8a03b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:06.950507 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dadd9790-38b3-49bb-a32a-4422cea8a03b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:06.951067 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dadd9790-38b3-49bb-a32a-4422cea8a03b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:07.093758 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dadd9790-38b3-49bb-a32a-4422cea8a03b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:07.101976 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dadd9790-38b3-49bb-a32a-4422cea8a03b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.170354 Dec 15 14:15:07.102525 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 622/1236] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:06 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:08.119727 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e642566d-c319-4eee-af48-e5b0cb2162c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:08.120311 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e642566d-c319-4eee-af48-e5b0cb2162c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:08.127470 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e642566d-c319-4eee-af48-e5b0cb2162c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:08.127920 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e642566d-c319-4eee-af48-e5b0cb2162c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:08.128706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e642566d-c319-4eee-af48-e5b0cb2162c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:08.129144 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e642566d-c319-4eee-af48-e5b0cb2162c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:08.283176 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e642566d-c319-4eee-af48-e5b0cb2162c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:08.296856 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e642566d-c319-4eee-af48-e5b0cb2162c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.180861 Dec 15 14:15:08.297825 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 615/1237] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:08 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:09.319905 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c48255fb-e120-4e67-a42c-a4a198adab1c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:09.321019 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c48255fb-e120-4e67-a42c-a4a198adab1c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:09.331766 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c48255fb-e120-4e67-a42c-a4a198adab1c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:09.332424 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c48255fb-e120-4e67-a42c-a4a198adab1c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:09.333807 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c48255fb-e120-4e67-a42c-a4a198adab1c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:09.334265 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c48255fb-e120-4e67-a42c-a4a198adab1c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:09.485547 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c48255fb-e120-4e67-a42c-a4a198adab1c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:09.497681 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c48255fb-e120-4e67-a42c-a4a198adab1c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.183755 Dec 15 14:15:09.498505 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 623/1238] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:09 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:10.523094 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-68cfe18b-33dd-4a63-b362-5fa1498e1712 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:10.523814 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-68cfe18b-33dd-4a63-b362-5fa1498e1712 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:10.530916 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68cfe18b-33dd-4a63-b362-5fa1498e1712 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:10.531350 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68cfe18b-33dd-4a63-b362-5fa1498e1712 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:10.532140 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68cfe18b-33dd-4a63-b362-5fa1498e1712 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:10.532577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68cfe18b-33dd-4a63-b362-5fa1498e1712 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:10.677971 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-68cfe18b-33dd-4a63-b362-5fa1498e1712 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:10.686057 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-68cfe18b-33dd-4a63-b362-5fa1498e1712 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.169819 Dec 15 14:15:10.686630 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 616/1239] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:10 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:11.712698 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-47536cb6-1ebb-4ab8-a452-f79faf183141 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:11.714063 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-47536cb6-1ebb-4ab8-a452-f79faf183141 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:11.724926 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47536cb6-1ebb-4ab8-a452-f79faf183141 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:11.725779 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47536cb6-1ebb-4ab8-a452-f79faf183141 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:11.726600 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47536cb6-1ebb-4ab8-a452-f79faf183141 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:11.727042 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47536cb6-1ebb-4ab8-a452-f79faf183141 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:11.883007 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-47536cb6-1ebb-4ab8-a452-f79faf183141 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:11.890645 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-47536cb6-1ebb-4ab8-a452-f79faf183141 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.184447 Dec 15 14:15:11.891253 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 624/1240] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:11 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:12.918086 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a621c95f-9c14-4cc8-a690-af9bf1c291f2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:12.919076 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a621c95f-9c14-4cc8-a690-af9bf1c291f2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:12.929830 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a621c95f-9c14-4cc8-a690-af9bf1c291f2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:12.930281 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a621c95f-9c14-4cc8-a690-af9bf1c291f2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:12.931062 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a621c95f-9c14-4cc8-a690-af9bf1c291f2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:12.931489 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a621c95f-9c14-4cc8-a690-af9bf1c291f2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:13.089582 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a621c95f-9c14-4cc8-a690-af9bf1c291f2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:13.097829 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a621c95f-9c14-4cc8-a690-af9bf1c291f2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.186462 Dec 15 14:15:13.098401 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 617/1241] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:12 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:14.119802 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c8503f8e-1711-48c4-ba44-a078e03343f6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:14.120723 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c8503f8e-1711-48c4-ba44-a078e03343f6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:14.133570 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8503f8e-1711-48c4-ba44-a078e03343f6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:14.134043 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8503f8e-1711-48c4-ba44-a078e03343f6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:14.134822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8503f8e-1711-48c4-ba44-a078e03343f6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:14.135320 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8503f8e-1711-48c4-ba44-a078e03343f6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:14.283630 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c8503f8e-1711-48c4-ba44-a078e03343f6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:14.295473 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c8503f8e-1711-48c4-ba44-a078e03343f6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.181881 Dec 15 14:15:14.296257 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 625/1242] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:14 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:15.320644 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b67abccb-d18a-4ec5-aec8-1dce54cbb215 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:15.321269 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b67abccb-d18a-4ec5-aec8-1dce54cbb215 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:15.328628 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b67abccb-d18a-4ec5-aec8-1dce54cbb215 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:15.329101 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b67abccb-d18a-4ec5-aec8-1dce54cbb215 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:15.330174 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b67abccb-d18a-4ec5-aec8-1dce54cbb215 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:15.330576 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b67abccb-d18a-4ec5-aec8-1dce54cbb215 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:15.491471 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b67abccb-d18a-4ec5-aec8-1dce54cbb215 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:15.502641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b67abccb-d18a-4ec5-aec8-1dce54cbb215 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.188288 Dec 15 14:15:15.503398 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 618/1243] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:15 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:16.524150 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3da72256-c397-49d7-8804-a8c926ccc378 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:16.524787 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3da72256-c397-49d7-8804-a8c926ccc378 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:16.531478 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3da72256-c397-49d7-8804-a8c926ccc378 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:16.531922 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3da72256-c397-49d7-8804-a8c926ccc378 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:16.532696 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3da72256-c397-49d7-8804-a8c926ccc378 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:16.533121 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3da72256-c397-49d7-8804-a8c926ccc378 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:16.688939 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3da72256-c397-49d7-8804-a8c926ccc378 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:16.697057 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3da72256-c397-49d7-8804-a8c926ccc378 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.178576 Dec 15 14:15:16.697666 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 626/1244] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:16 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:17.718714 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-48473ab0-c275-492b-a7f5-d93f4467f01c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:17.719721 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-48473ab0-c275-492b-a7f5-d93f4467f01c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:17.729528 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48473ab0-c275-492b-a7f5-d93f4467f01c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:17.730024 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48473ab0-c275-492b-a7f5-d93f4467f01c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:17.730838 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48473ab0-c275-492b-a7f5-d93f4467f01c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:17.731310 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48473ab0-c275-492b-a7f5-d93f4467f01c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:17.879942 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-48473ab0-c275-492b-a7f5-d93f4467f01c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:17.891653 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-48473ab0-c275-492b-a7f5-d93f4467f01c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.179339 Dec 15 14:15:17.892379 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 619/1245] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:17 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:18.912015 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e40ee3f6-6e75-4cc3-ba5a-4ddf45709bd8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:18.912611 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e40ee3f6-6e75-4cc3-ba5a-4ddf45709bd8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:18.919475 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e40ee3f6-6e75-4cc3-ba5a-4ddf45709bd8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:18.919922 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e40ee3f6-6e75-4cc3-ba5a-4ddf45709bd8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:18.920695 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e40ee3f6-6e75-4cc3-ba5a-4ddf45709bd8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:18.921121 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e40ee3f6-6e75-4cc3-ba5a-4ddf45709bd8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:19.067306 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e40ee3f6-6e75-4cc3-ba5a-4ddf45709bd8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:19.079647 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e40ee3f6-6e75-4cc3-ba5a-4ddf45709bd8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.171336 Dec 15 14:15:19.080260 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 627/1246] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:18 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:20.101665 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e37e1037-eb22-4e82-97ea-709bf16392c7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:20.103038 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e37e1037-eb22-4e82-97ea-709bf16392c7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:20.109793 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e37e1037-eb22-4e82-97ea-709bf16392c7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:20.110248 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e37e1037-eb22-4e82-97ea-709bf16392c7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:20.111031 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e37e1037-eb22-4e82-97ea-709bf16392c7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:20.111507 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e37e1037-eb22-4e82-97ea-709bf16392c7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:20.262548 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e37e1037-eb22-4e82-97ea-709bf16392c7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:20.270817 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e37e1037-eb22-4e82-97ea-709bf16392c7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.175745 Dec 15 14:15:20.271374 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 620/1247] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:20 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:21.288408 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9d765979-29fa-4a41-8ff1-b911fcb5378f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:21.289370 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9d765979-29fa-4a41-8ff1-b911fcb5378f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:21.296096 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d765979-29fa-4a41-8ff1-b911fcb5378f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:21.296546 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d765979-29fa-4a41-8ff1-b911fcb5378f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:21.297332 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d765979-29fa-4a41-8ff1-b911fcb5378f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:21.297804 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d765979-29fa-4a41-8ff1-b911fcb5378f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:21.442048 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9d765979-29fa-4a41-8ff1-b911fcb5378f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:21.451894 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9d765979-29fa-4a41-8ff1-b911fcb5378f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.167259 Dec 15 14:15:21.452494 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 628/1248] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:21 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:22.474212 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fc36804d-5881-4dfc-9f21-4fefbd3a3b2a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:22.475356 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fc36804d-5881-4dfc-9f21-4fefbd3a3b2a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:22.484495 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc36804d-5881-4dfc-9f21-4fefbd3a3b2a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:22.484938 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc36804d-5881-4dfc-9f21-4fefbd3a3b2a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:22.485749 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc36804d-5881-4dfc-9f21-4fefbd3a3b2a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:22.486185 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc36804d-5881-4dfc-9f21-4fefbd3a3b2a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:22.636828 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fc36804d-5881-4dfc-9f21-4fefbd3a3b2a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:22.644750 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fc36804d-5881-4dfc-9f21-4fefbd3a3b2a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.177237 Dec 15 14:15:22.645336 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 621/1249] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:22 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:23.666314 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1ad694ce-6817-4e6d-8f13-6a633f6a5314 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:23.667396 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1ad694ce-6817-4e6d-8f13-6a633f6a5314 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:23.674340 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ad694ce-6817-4e6d-8f13-6a633f6a5314 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:23.674790 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ad694ce-6817-4e6d-8f13-6a633f6a5314 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:23.675564 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ad694ce-6817-4e6d-8f13-6a633f6a5314 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:23.676006 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ad694ce-6817-4e6d-8f13-6a633f6a5314 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:23.825406 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1ad694ce-6817-4e6d-8f13-6a633f6a5314 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:23.833053 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1ad694ce-6817-4e6d-8f13-6a633f6a5314 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.172942 Dec 15 14:15:23.833633 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 629/1250] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:23 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:24.856461 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9eeeb40c-de26-470f-8e84-f22a6b35890d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:24.857531 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9eeeb40c-de26-470f-8e84-f22a6b35890d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:24.868278 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9eeeb40c-de26-470f-8e84-f22a6b35890d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:24.869014 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9eeeb40c-de26-470f-8e84-f22a6b35890d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:24.870402 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9eeeb40c-de26-470f-8e84-f22a6b35890d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:24.870850 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9eeeb40c-de26-470f-8e84-f22a6b35890d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:25.014923 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9eeeb40c-de26-470f-8e84-f22a6b35890d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:25.026727 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9eeeb40c-de26-470f-8e84-f22a6b35890d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.176659 Dec 15 14:15:25.027466 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 622/1251] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:24 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:26.054050 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9c71070a-45cf-403d-aeab-7b22e746ddcb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:26.054904 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9c71070a-45cf-403d-aeab-7b22e746ddcb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:26.066144 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c71070a-45cf-403d-aeab-7b22e746ddcb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:26.066890 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c71070a-45cf-403d-aeab-7b22e746ddcb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:26.068281 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c71070a-45cf-403d-aeab-7b22e746ddcb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:26.068999 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c71070a-45cf-403d-aeab-7b22e746ddcb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:26.215416 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9c71070a-45cf-403d-aeab-7b22e746ddcb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:26.223769 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9c71070a-45cf-403d-aeab-7b22e746ddcb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.176492 Dec 15 14:15:26.224339 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 630/1252] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:26 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:27.245031 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7a759e91-53ec-4b63-836d-d59ca89de91f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:27.246038 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7a759e91-53ec-4b63-836d-d59ca89de91f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:27.257010 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a759e91-53ec-4b63-836d-d59ca89de91f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:27.257886 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a759e91-53ec-4b63-836d-d59ca89de91f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:27.259179 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a759e91-53ec-4b63-836d-d59ca89de91f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:27.259918 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a759e91-53ec-4b63-836d-d59ca89de91f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:27.402304 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7a759e91-53ec-4b63-836d-d59ca89de91f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:27.409668 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7a759e91-53ec-4b63-836d-d59ca89de91f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.170885 Dec 15 14:15:27.410206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 623/1253] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:27 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:28.430740 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-463791c3-3fc1-4bae-9698-ae4803a2c8ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:28.431399 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-463791c3-3fc1-4bae-9698-ae4803a2c8ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:28.438354 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-463791c3-3fc1-4bae-9698-ae4803a2c8ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:28.438826 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-463791c3-3fc1-4bae-9698-ae4803a2c8ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:28.439573 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-463791c3-3fc1-4bae-9698-ae4803a2c8ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:28.440000 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-463791c3-3fc1-4bae-9698-ae4803a2c8ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:28.647346 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-463791c3-3fc1-4bae-9698-ae4803a2c8ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:28.655220 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-463791c3-3fc1-4bae-9698-ae4803a2c8ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.228254 Dec 15 14:15:28.655847 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 631/1254] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:28 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:29.675781 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4ee56e8b-c180-4845-b660-33316f42ef91 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:29.676551 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4ee56e8b-c180-4845-b660-33316f42ef91 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:29.685310 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ee56e8b-c180-4845-b660-33316f42ef91 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:29.685961 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ee56e8b-c180-4845-b660-33316f42ef91 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:29.686978 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ee56e8b-c180-4845-b660-33316f42ef91 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:29.687802 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ee56e8b-c180-4845-b660-33316f42ef91 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:29.838892 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4ee56e8b-c180-4845-b660-33316f42ef91 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:29.847265 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4ee56e8b-c180-4845-b660-33316f42ef91 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.176906 Dec 15 14:15:29.847809 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 624/1255] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:29 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:30.866825 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b1d664a7-a932-4bc8-86d6-da2fc581dbb8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:30.867422 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b1d664a7-a932-4bc8-86d6-da2fc581dbb8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:30.876406 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1d664a7-a932-4bc8-86d6-da2fc581dbb8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:30.876849 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1d664a7-a932-4bc8-86d6-da2fc581dbb8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:30.877650 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1d664a7-a932-4bc8-86d6-da2fc581dbb8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:30.878162 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1d664a7-a932-4bc8-86d6-da2fc581dbb8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:31.034235 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b1d664a7-a932-4bc8-86d6-da2fc581dbb8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:31.045659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b1d664a7-a932-4bc8-86d6-da2fc581dbb8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.184391 Dec 15 14:15:31.046283 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 632/1256] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:30 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:32.066555 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f236b090-9b3e-4bd2-81ac-89c5801af51d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:32.067236 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f236b090-9b3e-4bd2-81ac-89c5801af51d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:32.075457 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f236b090-9b3e-4bd2-81ac-89c5801af51d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:32.076062 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f236b090-9b3e-4bd2-81ac-89c5801af51d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:32.077045 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f236b090-9b3e-4bd2-81ac-89c5801af51d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:32.077592 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f236b090-9b3e-4bd2-81ac-89c5801af51d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:32.224949 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f236b090-9b3e-4bd2-81ac-89c5801af51d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:32.232997 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f236b090-9b3e-4bd2-81ac-89c5801af51d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.171941 Dec 15 14:15:32.233566 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 625/1257] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:32 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:33.251920 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0a017d06-508d-4a38-b54d-8d2eb0f7fa0b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:33.252852 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0a017d06-508d-4a38-b54d-8d2eb0f7fa0b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:33.260333 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a017d06-508d-4a38-b54d-8d2eb0f7fa0b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:33.260778 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a017d06-508d-4a38-b54d-8d2eb0f7fa0b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:33.261560 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a017d06-508d-4a38-b54d-8d2eb0f7fa0b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:33.262018 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a017d06-508d-4a38-b54d-8d2eb0f7fa0b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:33.402397 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0a017d06-508d-4a38-b54d-8d2eb0f7fa0b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:33.414167 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0a017d06-508d-4a38-b54d-8d2eb0f7fa0b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.165756 Dec 15 14:15:33.415128 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 633/1258] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:33 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:34.437023 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9d299aa0-6c16-4f25-8bac-c404114ed9ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:34.438304 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9d299aa0-6c16-4f25-8bac-c404114ed9ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:34.447063 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d299aa0-6c16-4f25-8bac-c404114ed9ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:34.447506 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d299aa0-6c16-4f25-8bac-c404114ed9ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:34.448331 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d299aa0-6c16-4f25-8bac-c404114ed9ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:34.448769 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d299aa0-6c16-4f25-8bac-c404114ed9ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:34.818080 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9d299aa0-6c16-4f25-8bac-c404114ed9ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:34.826051 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9d299aa0-6c16-4f25-8bac-c404114ed9ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.395459 Dec 15 14:15:34.826632 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 626/1259] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:34 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:35.846302 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4ba977aa-1947-4499-949a-c104873ff718 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:35.846912 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4ba977aa-1947-4499-949a-c104873ff718 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:35.853645 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ba977aa-1947-4499-949a-c104873ff718 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:35.854155 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ba977aa-1947-4499-949a-c104873ff718 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:35.854935 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ba977aa-1947-4499-949a-c104873ff718 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:35.855370 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ba977aa-1947-4499-949a-c104873ff718 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:35.998320 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4ba977aa-1947-4499-949a-c104873ff718 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:36.007843 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4ba977aa-1947-4499-949a-c104873ff718 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.166704 Dec 15 14:15:36.008449 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 634/1260] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:35 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:37.028884 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a584410f-bee7-4f25-99b3-b49edccddf2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:37.029808 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a584410f-bee7-4f25-99b3-b49edccddf2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:37.041545 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a584410f-bee7-4f25-99b3-b49edccddf2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:37.042252 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a584410f-bee7-4f25-99b3-b49edccddf2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:37.043559 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a584410f-bee7-4f25-99b3-b49edccddf2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:37.044972 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a584410f-bee7-4f25-99b3-b49edccddf2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:37.199144 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a584410f-bee7-4f25-99b3-b49edccddf2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:37.207345 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a584410f-bee7-4f25-99b3-b49edccddf2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.184918 Dec 15 14:15:37.207909 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 627/1261] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:37 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:38.226944 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-93df439e-6fb8-4431-b85d-4215d494d08f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:38.227650 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-93df439e-6fb8-4431-b85d-4215d494d08f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:38.234498 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93df439e-6fb8-4431-b85d-4215d494d08f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:38.234949 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93df439e-6fb8-4431-b85d-4215d494d08f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:38.235724 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93df439e-6fb8-4431-b85d-4215d494d08f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:38.236167 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93df439e-6fb8-4431-b85d-4215d494d08f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:38.382382 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-93df439e-6fb8-4431-b85d-4215d494d08f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:38.390592 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-93df439e-6fb8-4431-b85d-4215d494d08f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.167783 Dec 15 14:15:38.391178 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 635/1262] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:38 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:39.412188 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-62fafb75-832c-4644-95a5-c31e4f828b8e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:39.412752 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-62fafb75-832c-4644-95a5-c31e4f828b8e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:39.419404 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62fafb75-832c-4644-95a5-c31e4f828b8e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:39.419857 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62fafb75-832c-4644-95a5-c31e4f828b8e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:39.420626 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62fafb75-832c-4644-95a5-c31e4f828b8e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:39.421057 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62fafb75-832c-4644-95a5-c31e4f828b8e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:39.568127 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-62fafb75-832c-4644-95a5-c31e4f828b8e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:39.579637 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-62fafb75-832c-4644-95a5-c31e4f828b8e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.173520 Dec 15 14:15:39.580413 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 628/1263] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:39 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:40.598355 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e02b50e1-0ba0-49af-8726-664d65b45bdf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:40.599681 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e02b50e1-0ba0-49af-8726-664d65b45bdf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:40.606920 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e02b50e1-0ba0-49af-8726-664d65b45bdf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:40.607394 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e02b50e1-0ba0-49af-8726-664d65b45bdf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:40.608230 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e02b50e1-0ba0-49af-8726-664d65b45bdf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:40.608688 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e02b50e1-0ba0-49af-8726-664d65b45bdf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:40.760251 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e02b50e1-0ba0-49af-8726-664d65b45bdf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:40.770969 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e02b50e1-0ba0-49af-8726-664d65b45bdf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.176085 Dec 15 14:15:40.771506 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 636/1264] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:40 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:41.790740 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0cf5b34b-1a2c-4a07-8a29-836ac766aef4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:41.791463 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0cf5b34b-1a2c-4a07-8a29-836ac766aef4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:41.798052 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0cf5b34b-1a2c-4a07-8a29-836ac766aef4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:41.798504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0cf5b34b-1a2c-4a07-8a29-836ac766aef4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:41.799279 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0cf5b34b-1a2c-4a07-8a29-836ac766aef4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:41.799717 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0cf5b34b-1a2c-4a07-8a29-836ac766aef4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:41.947258 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0cf5b34b-1a2c-4a07-8a29-836ac766aef4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:41.959100 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0cf5b34b-1a2c-4a07-8a29-836ac766aef4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.173050 Dec 15 14:15:41.959882 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 629/1265] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:41 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:42.980477 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-89e6d782-0eb4-4f99-805b-081e580c902d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:42.981390 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-89e6d782-0eb4-4f99-805b-081e580c902d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:42.991109 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89e6d782-0eb4-4f99-805b-081e580c902d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:42.991560 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89e6d782-0eb4-4f99-805b-081e580c902d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:42.992346 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89e6d782-0eb4-4f99-805b-081e580c902d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:42.992777 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89e6d782-0eb4-4f99-805b-081e580c902d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:43.146514 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-89e6d782-0eb4-4f99-805b-081e580c902d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:43.157053 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-89e6d782-0eb4-4f99-805b-081e580c902d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.182524 Dec 15 14:15:43.157945 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 637/1266] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:42 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:44.179795 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ac23402b-615b-4fff-af0d-ceddd7141bd1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:44.180779 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ac23402b-615b-4fff-af0d-ceddd7141bd1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:44.191767 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac23402b-615b-4fff-af0d-ceddd7141bd1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:44.192534 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac23402b-615b-4fff-af0d-ceddd7141bd1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:44.193636 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac23402b-615b-4fff-af0d-ceddd7141bd1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:44.194179 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac23402b-615b-4fff-af0d-ceddd7141bd1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:44.339967 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ac23402b-615b-4fff-af0d-ceddd7141bd1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:44.351709 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ac23402b-615b-4fff-af0d-ceddd7141bd1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.178057 Dec 15 14:15:44.352583 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 630/1267] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:44 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:45.377722 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b05cdfc8-2b8c-4596-834a-793dd8d9057f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:45.378617 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b05cdfc8-2b8c-4596-834a-793dd8d9057f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:45.386897 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b05cdfc8-2b8c-4596-834a-793dd8d9057f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:45.387336 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b05cdfc8-2b8c-4596-834a-793dd8d9057f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:45.388105 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b05cdfc8-2b8c-4596-834a-793dd8d9057f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:45.388534 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b05cdfc8-2b8c-4596-834a-793dd8d9057f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:45.549687 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b05cdfc8-2b8c-4596-834a-793dd8d9057f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:45.561072 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b05cdfc8-2b8c-4596-834a-793dd8d9057f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.189528 Dec 15 14:15:45.561793 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 638/1268] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:45 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:46.579115 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-91e0d906-45e3-40aa-a119-4316928cc2be tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:46.579762 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-91e0d906-45e3-40aa-a119-4316928cc2be tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:46.587031 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-91e0d906-45e3-40aa-a119-4316928cc2be tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:46.587477 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-91e0d906-45e3-40aa-a119-4316928cc2be tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:46.588556 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-91e0d906-45e3-40aa-a119-4316928cc2be tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:46.588984 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-91e0d906-45e3-40aa-a119-4316928cc2be tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:46.750671 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-91e0d906-45e3-40aa-a119-4316928cc2be tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:46.762786 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-91e0d906-45e3-40aa-a119-4316928cc2be tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.187535 Dec 15 14:15:46.763367 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 631/1269] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:46 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:47.782840 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8fac5b9d-1497-4819-8803-d01e1ce63e1b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:47.783443 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8fac5b9d-1497-4819-8803-d01e1ce63e1b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:47.790633 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8fac5b9d-1497-4819-8803-d01e1ce63e1b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:47.791072 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8fac5b9d-1497-4819-8803-d01e1ce63e1b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:47.791840 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8fac5b9d-1497-4819-8803-d01e1ce63e1b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:47.792268 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8fac5b9d-1497-4819-8803-d01e1ce63e1b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:47.942220 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8fac5b9d-1497-4819-8803-d01e1ce63e1b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:47.950525 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8fac5b9d-1497-4819-8803-d01e1ce63e1b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.171299 Dec 15 14:15:47.951127 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 639/1270] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:47 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:48.973242 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1d5273da-e62e-4918-906e-ca9b7a2ca3fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:48.974339 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1d5273da-e62e-4918-906e-ca9b7a2ca3fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:48.984886 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d5273da-e62e-4918-906e-ca9b7a2ca3fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:48.985671 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d5273da-e62e-4918-906e-ca9b7a2ca3fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:48.986983 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d5273da-e62e-4918-906e-ca9b7a2ca3fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:48.987810 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d5273da-e62e-4918-906e-ca9b7a2ca3fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:49.140653 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1d5273da-e62e-4918-906e-ca9b7a2ca3fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:49.148649 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1d5273da-e62e-4918-906e-ca9b7a2ca3fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.181676 Dec 15 14:15:49.149214 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 632/1271] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:48 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:50.169752 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9aa52593-28dc-4a87-bd2c-2229c0bece9b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:50.170639 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9aa52593-28dc-4a87-bd2c-2229c0bece9b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:50.179009 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9aa52593-28dc-4a87-bd2c-2229c0bece9b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:50.179611 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9aa52593-28dc-4a87-bd2c-2229c0bece9b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:50.180903 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9aa52593-28dc-4a87-bd2c-2229c0bece9b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:50.181419 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9aa52593-28dc-4a87-bd2c-2229c0bece9b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:50.332647 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9aa52593-28dc-4a87-bd2c-2229c0bece9b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:50.342665 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9aa52593-28dc-4a87-bd2c-2229c0bece9b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.178657 Dec 15 14:15:50.343233 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 640/1272] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:50 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:51.369012 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7812f6e1-fad8-4a59-8f57-b02813ee4fce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:51.369993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7812f6e1-fad8-4a59-8f57-b02813ee4fce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:51.380733 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7812f6e1-fad8-4a59-8f57-b02813ee4fce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:51.381316 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7812f6e1-fad8-4a59-8f57-b02813ee4fce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:51.382695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7812f6e1-fad8-4a59-8f57-b02813ee4fce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:51.383431 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7812f6e1-fad8-4a59-8f57-b02813ee4fce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:51.533527 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7812f6e1-fad8-4a59-8f57-b02813ee4fce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:51.542245 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7812f6e1-fad8-4a59-8f57-b02813ee4fce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.183619 Dec 15 14:15:51.543545 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 633/1273] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:51 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:52.561120 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fd0d7671-6921-4c4a-81ea-d7c145493031 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:52.561804 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fd0d7671-6921-4c4a-81ea-d7c145493031 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:52.569008 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd0d7671-6921-4c4a-81ea-d7c145493031 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:52.569481 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd0d7671-6921-4c4a-81ea-d7c145493031 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:52.570348 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd0d7671-6921-4c4a-81ea-d7c145493031 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:52.570806 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd0d7671-6921-4c4a-81ea-d7c145493031 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:52.724379 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fd0d7671-6921-4c4a-81ea-d7c145493031 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:52.734354 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fd0d7671-6921-4c4a-81ea-d7c145493031 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.177499 Dec 15 14:15:52.734926 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 641/1274] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:52 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:53.757693 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6043ef60-f7ba-46ca-bcd8-b289b993ee1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:53.758764 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6043ef60-f7ba-46ca-bcd8-b289b993ee1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:53.766641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6043ef60-f7ba-46ca-bcd8-b289b993ee1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:53.767081 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6043ef60-f7ba-46ca-bcd8-b289b993ee1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:53.767855 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6043ef60-f7ba-46ca-bcd8-b289b993ee1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:53.768292 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6043ef60-f7ba-46ca-bcd8-b289b993ee1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:53.929625 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6043ef60-f7ba-46ca-bcd8-b289b993ee1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:53.937644 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6043ef60-f7ba-46ca-bcd8-b289b993ee1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.186140 Dec 15 14:15:53.938257 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 634/1275] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:53 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:15:54.958968 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-794bc799-e830-4ff2-8125-9ddb00a00343 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:54.959929 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-794bc799-e830-4ff2-8125-9ddb00a00343 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:54.968591 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-794bc799-e830-4ff2-8125-9ddb00a00343 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:54.969035 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-794bc799-e830-4ff2-8125-9ddb00a00343 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:54.969852 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-794bc799-e830-4ff2-8125-9ddb00a00343 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:54.970284 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-794bc799-e830-4ff2-8125-9ddb00a00343 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:55.116103 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-794bc799-e830-4ff2-8125-9ddb00a00343 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:55.124568 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-794bc799-e830-4ff2-8125-9ddb00a00343 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.171807 Dec 15 14:15:55.125167 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 642/1276] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:54 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:56.145548 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1c9f5906-f338-482a-b036-815fb861d7cc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:56.146240 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1c9f5906-f338-482a-b036-815fb861d7cc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:56.154888 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c9f5906-f338-482a-b036-815fb861d7cc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:56.155339 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c9f5906-f338-482a-b036-815fb861d7cc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:56.156130 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c9f5906-f338-482a-b036-815fb861d7cc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:56.156565 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c9f5906-f338-482a-b036-815fb861d7cc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:56.294453 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1c9f5906-f338-482a-b036-815fb861d7cc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:56.306714 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1c9f5906-f338-482a-b036-815fb861d7cc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.166837 Dec 15 14:15:56.307486 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 635/1277] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:56 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:57.327317 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-04ee0cc8-8067-4392-8f4c-83827d5f3daf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:57.327948 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-04ee0cc8-8067-4392-8f4c-83827d5f3daf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:57.334972 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-04ee0cc8-8067-4392-8f4c-83827d5f3daf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:57.335396 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-04ee0cc8-8067-4392-8f4c-83827d5f3daf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:57.336161 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-04ee0cc8-8067-4392-8f4c-83827d5f3daf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:57.336596 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-04ee0cc8-8067-4392-8f4c-83827d5f3daf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:57.485707 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-04ee0cc8-8067-4392-8f4c-83827d5f3daf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:57.496846 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-04ee0cc8-8067-4392-8f4c-83827d5f3daf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.174169 Dec 15 14:15:57.497659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 643/1278] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:57 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:58.515596 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5a1d5aaf-e0d1-4d99-b503-44dedfea8c2b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:58.516277 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5a1d5aaf-e0d1-4d99-b503-44dedfea8c2b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:58.524283 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a1d5aaf-e0d1-4d99-b503-44dedfea8c2b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:58.524812 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a1d5aaf-e0d1-4d99-b503-44dedfea8c2b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:58.525813 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a1d5aaf-e0d1-4d99-b503-44dedfea8c2b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:58.526322 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a1d5aaf-e0d1-4d99-b503-44dedfea8c2b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:58.664727 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5a1d5aaf-e0d1-4d99-b503-44dedfea8c2b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:58.672577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5a1d5aaf-e0d1-4d99-b503-44dedfea8c2b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.161853 Dec 15 14:15:58.673145 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 636/1279] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:58 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:59.699602 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e42ebb69-6542-462d-8f31-a15bfd1c4b4c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:59.700744 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e42ebb69-6542-462d-8f31-a15bfd1c4b4c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:59.711851 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e42ebb69-6542-462d-8f31-a15bfd1c4b4c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:59.712957 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e42ebb69-6542-462d-8f31-a15bfd1c4b4c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:59.714322 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e42ebb69-6542-462d-8f31-a15bfd1c4b4c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:59.715050 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e42ebb69-6542-462d-8f31-a15bfd1c4b4c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:59.856751 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e42ebb69-6542-462d-8f31-a15bfd1c4b4c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:59.865228 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e42ebb69-6542-462d-8f31-a15bfd1c4b4c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.171978 Dec 15 14:15:59.865846 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 644/1280] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:59 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:00.886523 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9d53caf7-c749-482a-955c-3abd01530ca5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:00.887434 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9d53caf7-c749-482a-955c-3abd01530ca5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:00.894704 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d53caf7-c749-482a-955c-3abd01530ca5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:00.895183 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d53caf7-c749-482a-955c-3abd01530ca5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:00.895955 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d53caf7-c749-482a-955c-3abd01530ca5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:00.896479 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d53caf7-c749-482a-955c-3abd01530ca5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:01.042116 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9d53caf7-c749-482a-955c-3abd01530ca5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:01.054036 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9d53caf7-c749-482a-955c-3abd01530ca5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.173463 Dec 15 14:16:01.054777 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 637/1281] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:00 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:02.078422 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fc84e5e7-e9e5-4847-b9cd-573df598964b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:02.079318 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fc84e5e7-e9e5-4847-b9cd-573df598964b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:02.086273 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc84e5e7-e9e5-4847-b9cd-573df598964b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:02.086729 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc84e5e7-e9e5-4847-b9cd-573df598964b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:02.087833 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc84e5e7-e9e5-4847-b9cd-573df598964b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:02.088273 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc84e5e7-e9e5-4847-b9cd-573df598964b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:02.226474 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fc84e5e7-e9e5-4847-b9cd-573df598964b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:02.234674 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fc84e5e7-e9e5-4847-b9cd-573df598964b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.162531 Dec 15 14:16:02.235378 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 645/1282] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:02 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:03.256614 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c8be6e0c-bb56-450a-bcb6-96d182e82587 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:03.257674 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c8be6e0c-bb56-450a-bcb6-96d182e82587 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:03.268637 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c8be6e0c-bb56-450a-bcb6-96d182e82587 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:03.269401 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c8be6e0c-bb56-450a-bcb6-96d182e82587 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:03.270759 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c8be6e0c-bb56-450a-bcb6-96d182e82587 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:03.271490 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c8be6e0c-bb56-450a-bcb6-96d182e82587 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:03.423846 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c8be6e0c-bb56-450a-bcb6-96d182e82587 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:03.434187 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c8be6e0c-bb56-450a-bcb6-96d182e82587 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.184280 Dec 15 14:16:03.435030 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 638/1283] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:03 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:04.456437 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-67594f96-8316-4f17-b9b3-ee66f7d4da5b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:04.457304 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-67594f96-8316-4f17-b9b3-ee66f7d4da5b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:04.468673 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67594f96-8316-4f17-b9b3-ee66f7d4da5b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:04.469419 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67594f96-8316-4f17-b9b3-ee66f7d4da5b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:04.470780 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67594f96-8316-4f17-b9b3-ee66f7d4da5b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:04.471221 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67594f96-8316-4f17-b9b3-ee66f7d4da5b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:04.625468 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-67594f96-8316-4f17-b9b3-ee66f7d4da5b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:04.637537 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-67594f96-8316-4f17-b9b3-ee66f7d4da5b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.187434 Dec 15 14:16:04.638377 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 646/1284] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:04 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:05.655430 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6cd71bd9-44f4-48ce-a6d4-baf1c819ec61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:05.656058 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6cd71bd9-44f4-48ce-a6d4-baf1c819ec61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:05.662941 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6cd71bd9-44f4-48ce-a6d4-baf1c819ec61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:05.663382 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6cd71bd9-44f4-48ce-a6d4-baf1c819ec61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:05.664157 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6cd71bd9-44f4-48ce-a6d4-baf1c819ec61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:05.664585 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6cd71bd9-44f4-48ce-a6d4-baf1c819ec61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:05.816344 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6cd71bd9-44f4-48ce-a6d4-baf1c819ec61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:05.824948 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6cd71bd9-44f4-48ce-a6d4-baf1c819ec61 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.173315 Dec 15 14:16:05.825510 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 639/1285] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:05 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:06.847721 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8d116624-950e-426a-90bc-e184867a2992 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:06.848592 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8d116624-950e-426a-90bc-e184867a2992 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:06.857788 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d116624-950e-426a-90bc-e184867a2992 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:06.858441 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d116624-950e-426a-90bc-e184867a2992 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:06.859759 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d116624-950e-426a-90bc-e184867a2992 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:06.860135 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d116624-950e-426a-90bc-e184867a2992 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:07.006092 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8d116624-950e-426a-90bc-e184867a2992 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:07.013945 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8d116624-950e-426a-90bc-e184867a2992 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.171567 Dec 15 14:16:07.014506 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 647/1286] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:06 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:08.032121 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-13b8ff90-1a8f-4767-b484-f911e53afd87 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:08.033118 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-13b8ff90-1a8f-4767-b484-f911e53afd87 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:08.041164 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13b8ff90-1a8f-4767-b484-f911e53afd87 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:08.041632 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13b8ff90-1a8f-4767-b484-f911e53afd87 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:08.042420 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13b8ff90-1a8f-4767-b484-f911e53afd87 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:08.042849 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13b8ff90-1a8f-4767-b484-f911e53afd87 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:08.215231 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-13b8ff90-1a8f-4767-b484-f911e53afd87 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:08.225253 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-13b8ff90-1a8f-4767-b484-f911e53afd87 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.197661 Dec 15 14:16:08.225949 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 640/1287] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:08 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:09.248088 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fe2f1b32-67e6-4760-9927-8bceb6b9ace5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:09.249085 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fe2f1b32-67e6-4760-9927-8bceb6b9ace5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:09.260309 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe2f1b32-67e6-4760-9927-8bceb6b9ace5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:09.261062 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe2f1b32-67e6-4760-9927-8bceb6b9ace5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:09.262409 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe2f1b32-67e6-4760-9927-8bceb6b9ace5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:09.263131 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe2f1b32-67e6-4760-9927-8bceb6b9ace5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:09.419735 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fe2f1b32-67e6-4760-9927-8bceb6b9ace5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:09.427891 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fe2f1b32-67e6-4760-9927-8bceb6b9ace5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.186056 Dec 15 14:16:09.428455 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 648/1288] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:09 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:10.450883 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-401b82d3-b872-45f2-bdbe-5e8d3e907dde tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:10.451557 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-401b82d3-b872-45f2-bdbe-5e8d3e907dde tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:10.458835 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-401b82d3-b872-45f2-bdbe-5e8d3e907dde tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:10.459306 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-401b82d3-b872-45f2-bdbe-5e8d3e907dde tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:10.460110 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-401b82d3-b872-45f2-bdbe-5e8d3e907dde tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:10.460560 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-401b82d3-b872-45f2-bdbe-5e8d3e907dde tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:10.609026 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-401b82d3-b872-45f2-bdbe-5e8d3e907dde tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:10.617980 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-401b82d3-b872-45f2-bdbe-5e8d3e907dde tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.171009 Dec 15 14:16:10.618559 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 641/1289] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:10 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:11.638789 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d7e31f6a-7758-4d36-bdf6-f7617ec0aa83 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:11.639886 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d7e31f6a-7758-4d36-bdf6-f7617ec0aa83 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:11.648456 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7e31f6a-7758-4d36-bdf6-f7617ec0aa83 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:11.648909 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7e31f6a-7758-4d36-bdf6-f7617ec0aa83 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:11.649732 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7e31f6a-7758-4d36-bdf6-f7617ec0aa83 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:11.650260 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7e31f6a-7758-4d36-bdf6-f7617ec0aa83 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:11.792568 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d7e31f6a-7758-4d36-bdf6-f7617ec0aa83 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:11.800961 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d7e31f6a-7758-4d36-bdf6-f7617ec0aa83 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.168431 Dec 15 14:16:11.801535 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 649/1290] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:11 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:12.820592 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5e8d3f22-76d8-4e16-85cd-72da7885c135 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:12.821234 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5e8d3f22-76d8-4e16-85cd-72da7885c135 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:12.829881 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e8d3f22-76d8-4e16-85cd-72da7885c135 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:12.830347 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e8d3f22-76d8-4e16-85cd-72da7885c135 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:12.831345 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e8d3f22-76d8-4e16-85cd-72da7885c135 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:12.831905 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e8d3f22-76d8-4e16-85cd-72da7885c135 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:12.977963 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5e8d3f22-76d8-4e16-85cd-72da7885c135 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:12.988964 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5e8d3f22-76d8-4e16-85cd-72da7885c135 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.173319 Dec 15 14:16:12.989536 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 642/1291] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:12 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:14.009764 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9f9da3da-2651-4d81-959b-d9623623c5c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:14.010420 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9f9da3da-2651-4d81-959b-d9623623c5c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:14.020665 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f9da3da-2651-4d81-959b-d9623623c5c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:14.021245 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f9da3da-2651-4d81-959b-d9623623c5c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:14.022383 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f9da3da-2651-4d81-959b-d9623623c5c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:14.022984 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f9da3da-2651-4d81-959b-d9623623c5c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:14.172846 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9f9da3da-2651-4d81-959b-d9623623c5c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:14.184208 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9f9da3da-2651-4d81-959b-d9623623c5c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.179959 Dec 15 14:16:14.184968 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 650/1292] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:14 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:15.204434 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-10bb6ea7-1c3b-43b4-bda6-e1112b956683 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:15.205051 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-10bb6ea7-1c3b-43b4-bda6-e1112b956683 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:15.212329 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-10bb6ea7-1c3b-43b4-bda6-e1112b956683 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:15.212593 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-10bb6ea7-1c3b-43b4-bda6-e1112b956683 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:15.213382 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-10bb6ea7-1c3b-43b4-bda6-e1112b956683 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:15.213854 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-10bb6ea7-1c3b-43b4-bda6-e1112b956683 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:15.351894 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-10bb6ea7-1c3b-43b4-bda6-e1112b956683 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:15.359562 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-10bb6ea7-1c3b-43b4-bda6-e1112b956683 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.158852 Dec 15 14:16:15.360133 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 643/1293] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:15 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:15.559720 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-798c02de-c8f0-4097-9efa-500c017094da tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:15.560247 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-798c02de-c8f0-4097-9efa-500c017094da tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:15.569785 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-798c02de-c8f0-4097-9efa-500c017094da tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:15.570496 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-798c02de-c8f0-4097-9efa-500c017094da tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:15.571478 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-798c02de-c8f0-4097-9efa-500c017094da tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:15.572077 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-798c02de-c8f0-4097-9efa-500c017094da tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:16.380968 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-57263bfe-cc5c-49c4-87e0-63ae5ac62a3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:16.381631 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-57263bfe-cc5c-49c4-87e0-63ae5ac62a3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:16.388795 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-57263bfe-cc5c-49c4-87e0-63ae5ac62a3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:16.389270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-57263bfe-cc5c-49c4-87e0-63ae5ac62a3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:16.390126 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-57263bfe-cc5c-49c4-87e0-63ae5ac62a3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:16.390582 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-57263bfe-cc5c-49c4-87e0-63ae5ac62a3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:16.530603 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-57263bfe-cc5c-49c4-87e0-63ae5ac62a3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:16.539126 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-57263bfe-cc5c-49c4-87e0-63ae5ac62a3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.164238 Dec 15 14:16:16.539713 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 644/1294] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:16 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:16.544117 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-685614cf-742e-4af8-89dd-ce47b34c2fff tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:16.545192 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-685614cf-742e-4af8-89dd-ce47b34c2fff tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:16.551071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-685614cf-742e-4af8-89dd-ce47b34c2fff tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:16.551707 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-685614cf-742e-4af8-89dd-ce47b34c2fff tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:16.552466 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-685614cf-742e-4af8-89dd-ce47b34c2fff tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:16.552901 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-685614cf-742e-4af8-89dd-ce47b34c2fff tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:16.578038 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-685614cf-742e-4af8-89dd-ce47b34c2fff tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:16:16.638196 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: ERROR oslo.messaging._drivers.impl_rabbit [None req-685614cf-742e-4af8-89dd-ce47b34c2fff tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [a2b14dff-eb4a-4e0e-8c5e-33f3e4e9e959] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 14:16:17.657019 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [None req-685614cf-742e-4af8-89dd-ce47b34c2fff tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [a2b14dff-eb4a-4e0e-8c5e-33f3e4e9e959] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 50566. Dec 15 14:16:17.687480 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-685614cf-742e-4af8-89dd-ce47b34c2fff tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "DELETE /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 204 len: 0 microversion: 2.1 time: 1.146468 Dec 15 14:16:17.688577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 645/1295] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:16:16 2021] DELETE /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 0 bytes in 1148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:16:17.694119 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ad994bb7-12dd-4fc7-a823-1db16ac2c5d7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:17.694842 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ad994bb7-12dd-4fc7-a823-1db16ac2c5d7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:17.700809 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad994bb7-12dd-4fc7-a823-1db16ac2c5d7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:17.701237 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad994bb7-12dd-4fc7-a823-1db16ac2c5d7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:17.702056 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad994bb7-12dd-4fc7-a823-1db16ac2c5d7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:17.702513 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad994bb7-12dd-4fc7-a823-1db16ac2c5d7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:17.855423 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ad994bb7-12dd-4fc7-a823-1db16ac2c5d7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:17.867844 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ad994bb7-12dd-4fc7-a823-1db16ac2c5d7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.177583 Dec 15 14:16:17.868719 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 646/1296] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:17 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:17.872996 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-17221dfe-7d55-4469-bca0-3856ed44ab84 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:17.873603 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-17221dfe-7d55-4469-bca0-3856ed44ab84 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:17.880719 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17221dfe-7d55-4469-bca0-3856ed44ab84 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:17.881170 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17221dfe-7d55-4469-bca0-3856ed44ab84 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:17.881990 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17221dfe-7d55-4469-bca0-3856ed44ab84 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:17.882429 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17221dfe-7d55-4469-bca0-3856ed44ab84 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:18.019470 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-17221dfe-7d55-4469-bca0-3856ed44ab84 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:18.027696 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-17221dfe-7d55-4469-bca0-3856ed44ab84 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1671 microversion: 2.1 time: 0.158013 Dec 15 14:16:18.028294 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 647/1297] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:17 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:18.887593 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c0063a95-d23a-4767-a1d3-9f35a1699acb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:18.888224 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c0063a95-d23a-4767-a1d3-9f35a1699acb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:18.895720 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0063a95-d23a-4767-a1d3-9f35a1699acb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:18.896106 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0063a95-d23a-4767-a1d3-9f35a1699acb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:18.896912 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0063a95-d23a-4767-a1d3-9f35a1699acb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:18.897318 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0063a95-d23a-4767-a1d3-9f35a1699acb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:19.181525 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c0063a95-d23a-4767-a1d3-9f35a1699acb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:19.189374 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c0063a95-d23a-4767-a1d3-9f35a1699acb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.306810 Dec 15 14:16:19.189989 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 648/1298] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:18 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:19.203792 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-37a911b1-c0cd-4c7c-bfb5-ed39c24b7548 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:19.204392 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-37a911b1-c0cd-4c7c-bfb5-ed39c24b7548 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:19.210986 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-37a911b1-c0cd-4c7c-bfb5-ed39c24b7548 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:19.211439 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-37a911b1-c0cd-4c7c-bfb5-ed39c24b7548 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:19.212576 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-37a911b1-c0cd-4c7c-bfb5-ed39c24b7548 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:19.213018 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-37a911b1-c0cd-4c7c-bfb5-ed39c24b7548 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:19.496465 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-37a911b1-c0cd-4c7c-bfb5-ed39c24b7548 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:19.504286 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-37a911b1-c0cd-4c7c-bfb5-ed39c24b7548 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1671 microversion: 2.1 time: 0.304000 Dec 15 14:16:19.505009 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 649/1299] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:19 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1671 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:20.242422 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-b732b0c2-9c2c-4f4d-8c16-d01c0918c6b8 req-1bbb4432-d791-4dbf-a14e-e5f41248a915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08832229-b545-4a06-a332-54ab9a72bacd", "name": "network-vif-deleted", "tag": "96478e00-8427-434c-8484-2d9c25c7698e"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:20.244010 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:16:20.244010 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:16:20.251646 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-b732b0c2-9c2c-4f4d-8c16-d01c0918c6b8 req-1bbb4432-d791-4dbf-a14e-e5f41248a915 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:20.252328 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-b732b0c2-9c2c-4f4d-8c16-d01c0918c6b8 req-1bbb4432-d791-4dbf-a14e-e5f41248a915 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:20.264672 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-b732b0c2-9c2c-4f4d-8c16-d01c0918c6b8 req-1bbb4432-d791-4dbf-a14e-e5f41248a915 service nova] Creating event network-vif-deleted:96478e00-8427-434c-8484-2d9c25c7698e for instance 08832229-b545-4a06-a332-54ab9a72bacd on hv-cinder-82182 Dec 15 14:16:20.269957 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-b732b0c2-9c2c-4f4d-8c16-d01c0918c6b8 req-1bbb4432-d791-4dbf-a14e-e5f41248a915 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154164 Dec 15 14:16:20.271063 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 650/1300] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:16:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:16:20.277212 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-322c4cb1-ff58-40d0-8c88-126cf621fa1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:20.278134 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-322c4cb1-ff58-40d0-8c88-126cf621fa1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:20.284548 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-322c4cb1-ff58-40d0-8c88-126cf621fa1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:20.284995 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-322c4cb1-ff58-40d0-8c88-126cf621fa1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:20.285972 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-322c4cb1-ff58-40d0-8c88-126cf621fa1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:20.286441 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-322c4cb1-ff58-40d0-8c88-126cf621fa1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:20.429816 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-322c4cb1-ff58-40d0-8c88-126cf621fa1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:20.438643 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-322c4cb1-ff58-40d0-8c88-126cf621fa1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.166254 Dec 15 14:16:20.439253 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 651/1301] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:20 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:20.522585 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7e0d2765-bbf3-49bc-a0cc-e7ad2318dec6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:20.523458 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7e0d2765-bbf3-49bc-a0cc-e7ad2318dec6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:20.529848 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e0d2765-bbf3-49bc-a0cc-e7ad2318dec6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:20.530608 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e0d2765-bbf3-49bc-a0cc-e7ad2318dec6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:20.531734 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e0d2765-bbf3-49bc-a0cc-e7ad2318dec6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:20.532304 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e0d2765-bbf3-49bc-a0cc-e7ad2318dec6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:20.569318 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e0d2765-bbf3-49bc-a0cc-e7ad2318dec6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:20.570054 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e0d2765-bbf3-49bc-a0cc-e7ad2318dec6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:20.570800 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-7e0d2765-bbf3-49bc-a0cc-e7ad2318dec6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lazy-loading 'fault' on Instance uuid 08832229-b545-4a06-a332-54ab9a72bacd {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:16:20.622106 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7e0d2765-bbf3-49bc-a0cc-e7ad2318dec6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:20.634164 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7e0d2765-bbf3-49bc-a0cc-e7ad2318dec6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 200 len: 1416 microversion: 2.1 time: 0.114965 Dec 15 14:16:20.635301 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 652/1302] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:20 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 1416 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:21.456705 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-00cfe85d-f09e-43a6-b043-8a4fdd845580 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:21.457341 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-00cfe85d-f09e-43a6-b043-8a4fdd845580 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:21.465315 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-00cfe85d-f09e-43a6-b043-8a4fdd845580 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:21.466150 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-00cfe85d-f09e-43a6-b043-8a4fdd845580 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:21.466931 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-00cfe85d-f09e-43a6-b043-8a4fdd845580 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:21.467398 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-00cfe85d-f09e-43a6-b043-8a4fdd845580 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:21.618195 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-00cfe85d-f09e-43a6-b043-8a4fdd845580 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:21.626660 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-00cfe85d-f09e-43a6-b043-8a4fdd845580 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.173368 Dec 15 14:16:21.626985 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 653/1303] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:21 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:21.652271 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-deb898b1-04c5-4ad5-98af-b0e234bd0e6c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:21.660173 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-deb898b1-04c5-4ad5-98af-b0e234bd0e6c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:21.667447 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-deb898b1-04c5-4ad5-98af-b0e234bd0e6c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:21.667903 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-deb898b1-04c5-4ad5-98af-b0e234bd0e6c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:21.668706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-deb898b1-04c5-4ad5-98af-b0e234bd0e6c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:21.669142 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-deb898b1-04c5-4ad5-98af-b0e234bd0e6c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:21.683535 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-deb898b1-04c5-4ad5-98af-b0e234bd0e6c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] HTTP exception thrown: Instance 08832229-b545-4a06-a332-54ab9a72bacd could not be found. Dec 15 14:16:21.684139 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-deb898b1-04c5-4ad5-98af-b0e234bd0e6c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Returning 404 to user: Instance 08832229-b545-4a06-a332-54ab9a72bacd could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:16:21.684982 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-deb898b1-04c5-4ad5-98af-b0e234bd0e6c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 404 len: 111 microversion: 2.1 time: 0.036485 Dec 15 14:16:21.685544 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 654/1304] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:21 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:16:21.694383 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-630c2fbb-9eb1-46a0-a5d0-2f240747d245 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '.version_select at 0x7faa414e88b0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:21.717798 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-630c2fbb-9eb1-46a0-a5d0-2f240747d245 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-219756940" status: 202 len: 0 microversion: 2.1 time: 0.027172 Dec 15 14:16:21.718535 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 655/1305] 10.222.0.42 () {58 vars in 1217 bytes} [Wed Dec 15 14:16:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-219756940 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:16:22.481800 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a937ec35-c3f0-4d29-aba8-bf79f3e57d3a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'create', calling method: .version_select at 0x7faa3c7cdaf0>, body: {"keypair": {"name": "tempest-keypair-1533284212"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:22.497537 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-a937ec35-c3f0-4d29-aba8-bf79f3e57d3a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Getting quotas for project db115a6a96f249a88a86dc25569d6ebc. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:16:22.501597 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-a937ec35-c3f0-4d29-aba8-bf79f3e57d3a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Getting quotas for user 68c5d857247f4fbabae43f49d3644d2e and project db115a6a96f249a88a86dc25569d6ebc. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:16:22.949116 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-a937ec35-c3f0-4d29-aba8-bf79f3e57d3a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Getting quotas for project db115a6a96f249a88a86dc25569d6ebc. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:16:22.952771 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-a937ec35-c3f0-4d29-aba8-bf79f3e57d3a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Getting quotas for user 68c5d857247f4fbabae43f49d3644d2e and project db115a6a96f249a88a86dc25569d6ebc. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:16:22.966675 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a937ec35-c3f0-4d29-aba8-bf79f3e57d3a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.489400 Dec 15 14:16:22.967274 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 656/1306] 10.222.0.42 () {60 vars in 1157 bytes} [Wed Dec 15 14:16:22 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:22.971597 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e584c400-641c-4594-9b96-60cf1932267e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:22.972188 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e584c400-641c-4594-9b96-60cf1932267e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:22.978730 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e584c400-641c-4594-9b96-60cf1932267e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:22.979221 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e584c400-641c-4594-9b96-60cf1932267e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:22.980052 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e584c400-641c-4594-9b96-60cf1932267e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:22.980490 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e584c400-641c-4594-9b96-60cf1932267e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:23.205125 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e584c400-641c-4594-9b96-60cf1932267e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:23.214443 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e584c400-641c-4594-9b96-60cf1932267e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.246112 Dec 15 14:16:23.215065 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 657/1307] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:22 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:24.232834 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-39716696-23b3-4c53-8c6b-e2e9b448dd1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:24.233543 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-39716696-23b3-4c53-8c6b-e2e9b448dd1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:24.240741 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39716696-23b3-4c53-8c6b-e2e9b448dd1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:24.241430 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39716696-23b3-4c53-8c6b-e2e9b448dd1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:24.242407 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39716696-23b3-4c53-8c6b-e2e9b448dd1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:24.243038 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39716696-23b3-4c53-8c6b-e2e9b448dd1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:24.474538 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-39716696-23b3-4c53-8c6b-e2e9b448dd1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:24.482508 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-39716696-23b3-4c53-8c6b-e2e9b448dd1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.253578 Dec 15 14:16:24.483396 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 658/1308] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:24 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:24.514465 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-93686585-71f1-49a3-a136-5631a5742ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-286437742", "imageRef": "9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b346368-2300-48a0-8140-15a2e1ada590"}], "security_groups": [{"name": "tempest-securitygroup--1566525022"}], "key_name": "tempest-keypair-1533284212", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:24.637999 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-93686585-71f1-49a3-a136-5631a5742ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] validate_networks() for [('4b346368-2300-48a0-8140-15a2e1ada590', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:16:25.102182 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-93686585-71f1-49a3-a136-5631a5742ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:16:25.102583 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-93686585-71f1-49a3-a136-5631a5742ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:16:25.103050 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-93686585-71f1-49a3-a136-5631a5742ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:16:25.103468 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-93686585-71f1-49a3-a136-5631a5742ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:16:25.103934 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-93686585-71f1-49a3-a136-5631a5742ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:16:25.114006 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-93686585-71f1-49a3-a136-5631a5742ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:25.114456 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-93686585-71f1-49a3-a136-5631a5742ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:25.115269 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-93686585-71f1-49a3-a136-5631a5742ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:25.115728 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-93686585-71f1-49a3-a136-5631a5742ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:25.133367 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-93686585-71f1-49a3-a136-5631a5742ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Getting quotas for project db115a6a96f249a88a86dc25569d6ebc. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:16:25.138127 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-93686585-71f1-49a3-a136-5631a5742ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Getting quotas for user 68c5d857247f4fbabae43f49d3644d2e and project db115a6a96f249a88a86dc25569d6ebc. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:16:25.150171 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-93686585-71f1-49a3-a136-5631a5742ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:16:25.152473 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-93686585-71f1-49a3-a136-5631a5742ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:16:25.208396 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-93686585-71f1-49a3-a136-5631a5742ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.699353 Dec 15 14:16:25.209052 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 659/1309] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Dec 15 14:16:24 2021] POST /compute/v2.1/servers => generated 402 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:16:25.219291 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fbc86170-43e5-44b3-8abc-b62fe95cdf2d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:25.219898 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fbc86170-43e5-44b3-8abc-b62fe95cdf2d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:25.272930 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fbc86170-43e5-44b3-8abc-b62fe95cdf2d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:25.279980 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fbc86170-43e5-44b3-8abc-b62fe95cdf2d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9" status: 200 len: 1237 microversion: 2.1 time: 0.064163 Dec 15 14:16:25.280542 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 660/1310] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:25 2021] GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 => generated 1237 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:25.503196 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f789f7ea-56f4-468b-95bf-23e7fc902a6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:25.503801 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f789f7ea-56f4-468b-95bf-23e7fc902a6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:25.511113 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f789f7ea-56f4-468b-95bf-23e7fc902a6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:25.511560 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f789f7ea-56f4-468b-95bf-23e7fc902a6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:25.512382 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f789f7ea-56f4-468b-95bf-23e7fc902a6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:25.512796 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f789f7ea-56f4-468b-95bf-23e7fc902a6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:25.649324 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f789f7ea-56f4-468b-95bf-23e7fc902a6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:25.657830 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f789f7ea-56f4-468b-95bf-23e7fc902a6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.158378 Dec 15 14:16:25.658393 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 661/1311] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:25 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:26.297120 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7637bc36-4797-46ff-8d7f-ece3f75248c3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:26.297832 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7637bc36-4797-46ff-8d7f-ece3f75248c3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:26.305116 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7637bc36-4797-46ff-8d7f-ece3f75248c3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:26.305887 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7637bc36-4797-46ff-8d7f-ece3f75248c3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:26.306670 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7637bc36-4797-46ff-8d7f-ece3f75248c3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:26.307318 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7637bc36-4797-46ff-8d7f-ece3f75248c3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:26.397154 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7637bc36-4797-46ff-8d7f-ece3f75248c3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:26.405527 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7637bc36-4797-46ff-8d7f-ece3f75248c3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9" status: 200 len: 1297 microversion: 2.1 time: 0.112195 Dec 15 14:16:26.406368 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 662/1312] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:26 2021] GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 => generated 1297 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:26.678506 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4040aa1e-a6c0-4580-b284-f3d8005a5f49 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:26.682185 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4040aa1e-a6c0-4580-b284-f3d8005a5f49 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:26.689826 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4040aa1e-a6c0-4580-b284-f3d8005a5f49 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:26.690589 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4040aa1e-a6c0-4580-b284-f3d8005a5f49 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:26.691934 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4040aa1e-a6c0-4580-b284-f3d8005a5f49 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:26.692722 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4040aa1e-a6c0-4580-b284-f3d8005a5f49 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:26.945964 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4040aa1e-a6c0-4580-b284-f3d8005a5f49 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:26.957256 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4040aa1e-a6c0-4580-b284-f3d8005a5f49 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.283190 Dec 15 14:16:26.958348 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 663/1313] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:26 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:27.423375 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9b051a34-f317-401c-85ca-c0561830e084 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:27.424083 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9b051a34-f317-401c-85ca-c0561830e084 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:27.430636 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9b051a34-f317-401c-85ca-c0561830e084 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:27.431079 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9b051a34-f317-401c-85ca-c0561830e084 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:27.431852 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9b051a34-f317-401c-85ca-c0561830e084 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:27.432280 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9b051a34-f317-401c-85ca-c0561830e084 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:27.641043 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9b051a34-f317-401c-85ca-c0561830e084 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:27.648588 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9b051a34-f317-401c-85ca-c0561830e084 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9" status: 200 len: 1363 microversion: 2.1 time: 0.228818 Dec 15 14:16:27.649184 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 664/1314] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:27 2021] GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:27.919965 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-a7467c4f-ef41-41e9-8bef-177662e562d3 req-18790c37-13b1-40bb-a89e-e91b07b074c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9", "tag": "88814554-f9b3-47cc-bddd-5c6dc6942720"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:27.921836 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:16:27.921836 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:16:27.929815 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-a7467c4f-ef41-41e9-8bef-177662e562d3 req-18790c37-13b1-40bb-a89e-e91b07b074c8 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:27.930254 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-a7467c4f-ef41-41e9-8bef-177662e562d3 req-18790c37-13b1-40bb-a89e-e91b07b074c8 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:27.942030 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-a7467c4f-ef41-41e9-8bef-177662e562d3 req-18790c37-13b1-40bb-a89e-e91b07b074c8 service nova] Creating event network-changed:88814554-f9b3-47cc-bddd-5c6dc6942720 for instance f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 on hv-cinder-82182 Dec 15 14:16:27.953444 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-a7467c4f-ef41-41e9-8bef-177662e562d3 req-18790c37-13b1-40bb-a89e-e91b07b074c8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037992 Dec 15 14:16:27.954328 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 665/1315] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:16:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:16:27.976725 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4627aaa9-8641-486d-8349-cf688fe4a2b8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:27.977713 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4627aaa9-8641-486d-8349-cf688fe4a2b8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:27.984077 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4627aaa9-8641-486d-8349-cf688fe4a2b8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:27.984800 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4627aaa9-8641-486d-8349-cf688fe4a2b8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:27.985636 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4627aaa9-8641-486d-8349-cf688fe4a2b8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:27.986069 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4627aaa9-8641-486d-8349-cf688fe4a2b8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:28.221185 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4627aaa9-8641-486d-8349-cf688fe4a2b8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:28.229579 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4627aaa9-8641-486d-8349-cf688fe4a2b8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.257092 Dec 15 14:16:28.230176 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 666/1316] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:27 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:28.666163 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3fa939d7-4755-4a53-bbae-95f63959e146 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:28.666930 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3fa939d7-4755-4a53-bbae-95f63959e146 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:28.677437 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3fa939d7-4755-4a53-bbae-95f63959e146 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:28.677896 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3fa939d7-4755-4a53-bbae-95f63959e146 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:28.678695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3fa939d7-4755-4a53-bbae-95f63959e146 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:28.679166 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3fa939d7-4755-4a53-bbae-95f63959e146 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:28.878414 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3fa939d7-4755-4a53-bbae-95f63959e146 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:28.886082 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3fa939d7-4755-4a53-bbae-95f63959e146 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9" status: 200 len: 1363 microversion: 2.1 time: 0.223998 Dec 15 14:16:28.886689 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 667/1317] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:28 2021] GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:29.251599 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-abd77ee0-e4c7-4bb7-b8e6-f86edd2381b8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:29.252765 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-abd77ee0-e4c7-4bb7-b8e6-f86edd2381b8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:29.261085 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abd77ee0-e4c7-4bb7-b8e6-f86edd2381b8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:29.262091 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abd77ee0-e4c7-4bb7-b8e6-f86edd2381b8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:29.262897 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abd77ee0-e4c7-4bb7-b8e6-f86edd2381b8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:29.263331 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abd77ee0-e4c7-4bb7-b8e6-f86edd2381b8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:29.699071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-abd77ee0-e4c7-4bb7-b8e6-f86edd2381b8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:29.707059 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-abd77ee0-e4c7-4bb7-b8e6-f86edd2381b8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.462426 Dec 15 14:16:29.707777 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 668/1318] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:29 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:29.903265 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b440bb48-0b98-49d1-8a61-c7888c8e3e30 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:29.903925 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b440bb48-0b98-49d1-8a61-c7888c8e3e30 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:29.910411 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b440bb48-0b98-49d1-8a61-c7888c8e3e30 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:29.911421 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b440bb48-0b98-49d1-8a61-c7888c8e3e30 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:29.911901 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b440bb48-0b98-49d1-8a61-c7888c8e3e30 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:29.912351 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b440bb48-0b98-49d1-8a61-c7888c8e3e30 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:30.128807 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b440bb48-0b98-49d1-8a61-c7888c8e3e30 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:30.136876 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b440bb48-0b98-49d1-8a61-c7888c8e3e30 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9" status: 200 len: 1363 microversion: 2.1 time: 0.237342 Dec 15 14:16:30.137466 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 669/1319] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:29 2021] GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:30.725375 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c1cf9f3c-7730-415f-966d-083056881974 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:30.726050 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c1cf9f3c-7730-415f-966d-083056881974 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:30.733595 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1cf9f3c-7730-415f-966d-083056881974 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:30.734055 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1cf9f3c-7730-415f-966d-083056881974 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:30.735037 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1cf9f3c-7730-415f-966d-083056881974 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:30.735468 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1cf9f3c-7730-415f-966d-083056881974 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:30.887929 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c1cf9f3c-7730-415f-966d-083056881974 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:30.896367 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c1cf9f3c-7730-415f-966d-083056881974 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.175043 Dec 15 14:16:30.896966 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 670/1320] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:30 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:31.163870 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fd0de305-ff18-404f-b55e-639ce5a7c1e2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:31.163870 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fd0de305-ff18-404f-b55e-639ce5a7c1e2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:31.170360 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd0de305-ff18-404f-b55e-639ce5a7c1e2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:31.170811 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd0de305-ff18-404f-b55e-639ce5a7c1e2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:31.171598 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd0de305-ff18-404f-b55e-639ce5a7c1e2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:31.172030 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd0de305-ff18-404f-b55e-639ce5a7c1e2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:31.312777 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fd0de305-ff18-404f-b55e-639ce5a7c1e2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:31.321060 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fd0de305-ff18-404f-b55e-639ce5a7c1e2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9" status: 200 len: 1363 microversion: 2.1 time: 0.163321 Dec 15 14:16:31.321641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 671/1321] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:31 2021] GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:31.913112 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2d4b910e-1f31-4838-a01e-efd655f51e59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:31.913877 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2d4b910e-1f31-4838-a01e-efd655f51e59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:31.920613 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d4b910e-1f31-4838-a01e-efd655f51e59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:31.921072 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d4b910e-1f31-4838-a01e-efd655f51e59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:31.921940 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d4b910e-1f31-4838-a01e-efd655f51e59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:31.922380 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d4b910e-1f31-4838-a01e-efd655f51e59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:32.065970 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2d4b910e-1f31-4838-a01e-efd655f51e59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:32.074114 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2d4b910e-1f31-4838-a01e-efd655f51e59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.164839 Dec 15 14:16:32.074670 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 672/1322] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:31 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:32.338673 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5b220b39-a7a9-4da7-bed6-ef406cb4418e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:32.339285 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5b220b39-a7a9-4da7-bed6-ef406cb4418e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:32.345638 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b220b39-a7a9-4da7-bed6-ef406cb4418e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:32.346100 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b220b39-a7a9-4da7-bed6-ef406cb4418e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:32.346874 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b220b39-a7a9-4da7-bed6-ef406cb4418e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:32.347310 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b220b39-a7a9-4da7-bed6-ef406cb4418e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:32.490492 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5b220b39-a7a9-4da7-bed6-ef406cb4418e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:32.498602 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5b220b39-a7a9-4da7-bed6-ef406cb4418e tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9" status: 200 len: 1363 microversion: 2.1 time: 0.163981 Dec 15 14:16:32.499171 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 673/1323] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:32 2021] GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:33.096221 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-42380d9c-8907-4170-a4c7-344da9d75f8a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:33.097037 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-42380d9c-8907-4170-a4c7-344da9d75f8a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:33.107582 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42380d9c-8907-4170-a4c7-344da9d75f8a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:33.108198 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42380d9c-8907-4170-a4c7-344da9d75f8a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:33.109426 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42380d9c-8907-4170-a4c7-344da9d75f8a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:33.110155 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42380d9c-8907-4170-a4c7-344da9d75f8a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:33.252132 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-42380d9c-8907-4170-a4c7-344da9d75f8a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:33.260008 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-42380d9c-8907-4170-a4c7-344da9d75f8a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.170312 Dec 15 14:16:33.260601 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 674/1324] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:33 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:33.557398 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-00dda459-e88f-463f-a265-247b98a6ea3f req-493fec40-0751-4c09-a4cd-433e14f3ce6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9", "name": "network-vif-plugged", "status": "completed", "tag": "88814554-f9b3-47cc-bddd-5c6dc6942720"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:33.559028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:16:33.559028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:16:33.566489 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-00dda459-e88f-463f-a265-247b98a6ea3f req-493fec40-0751-4c09-a4cd-433e14f3ce6b service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:33.566918 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-00dda459-e88f-463f-a265-247b98a6ea3f req-493fec40-0751-4c09-a4cd-433e14f3ce6b service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:33.578641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-00dda459-e88f-463f-a265-247b98a6ea3f req-493fec40-0751-4c09-a4cd-433e14f3ce6b service nova] Creating event network-vif-plugged:88814554-f9b3-47cc-bddd-5c6dc6942720 for instance f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 on hv-cinder-82182 Dec 15 14:16:33.583930 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-00dda459-e88f-463f-a265-247b98a6ea3f req-493fec40-0751-4c09-a4cd-433e14f3ce6b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226470 Dec 15 14:16:33.584694 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 675/1325] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:16:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:16:33.589830 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b0ca1f89-056d-4d99-9aa7-3548ed2b4eb3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:33.590529 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b0ca1f89-056d-4d99-9aa7-3548ed2b4eb3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:33.596535 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0ca1f89-056d-4d99-9aa7-3548ed2b4eb3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:33.596994 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0ca1f89-056d-4d99-9aa7-3548ed2b4eb3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:33.597786 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0ca1f89-056d-4d99-9aa7-3548ed2b4eb3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:33.598270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0ca1f89-056d-4d99-9aa7-3548ed2b4eb3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:33.742358 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b0ca1f89-056d-4d99-9aa7-3548ed2b4eb3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:33.752589 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b0ca1f89-056d-4d99-9aa7-3548ed2b4eb3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9" status: 200 len: 1363 microversion: 2.1 time: 0.166742 Dec 15 14:16:33.753424 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 676/1326] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:33 2021] GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:34.277728 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-08601735-7a69-4c4c-b087-fb246b7f8b70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:34.278451 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-08601735-7a69-4c4c-b087-fb246b7f8b70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:34.284961 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-08601735-7a69-4c4c-b087-fb246b7f8b70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:34.285409 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-08601735-7a69-4c4c-b087-fb246b7f8b70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:34.286210 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-08601735-7a69-4c4c-b087-fb246b7f8b70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:34.286642 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-08601735-7a69-4c4c-b087-fb246b7f8b70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:34.432880 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-08601735-7a69-4c4c-b087-fb246b7f8b70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:34.444549 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-08601735-7a69-4c4c-b087-fb246b7f8b70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.170708 Dec 15 14:16:34.445125 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 677/1327] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:34 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:34.769282 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9f7150bc-75fa-4aac-8cac-ad12cb2f23eb tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:34.769935 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9f7150bc-75fa-4aac-8cac-ad12cb2f23eb tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:34.777113 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f7150bc-75fa-4aac-8cac-ad12cb2f23eb tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:34.777558 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f7150bc-75fa-4aac-8cac-ad12cb2f23eb tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:34.778453 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f7150bc-75fa-4aac-8cac-ad12cb2f23eb tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:34.778819 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f7150bc-75fa-4aac-8cac-ad12cb2f23eb tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:34.928509 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9f7150bc-75fa-4aac-8cac-ad12cb2f23eb tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:34.936358 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9f7150bc-75fa-4aac-8cac-ad12cb2f23eb tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9" status: 200 len: 1363 microversion: 2.1 time: 0.170778 Dec 15 14:16:34.936980 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 678/1328] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:34 2021] GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:35.464481 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2ead49e5-db61-45db-8bfe-66d917f6eb8e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:35.465370 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2ead49e5-db61-45db-8bfe-66d917f6eb8e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:35.473983 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2ead49e5-db61-45db-8bfe-66d917f6eb8e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:35.474604 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2ead49e5-db61-45db-8bfe-66d917f6eb8e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:35.475830 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2ead49e5-db61-45db-8bfe-66d917f6eb8e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:35.476261 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2ead49e5-db61-45db-8bfe-66d917f6eb8e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:35.629075 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2ead49e5-db61-45db-8bfe-66d917f6eb8e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:35.637298 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2ead49e5-db61-45db-8bfe-66d917f6eb8e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.178143 Dec 15 14:16:35.637908 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 679/1329] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:35 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:35.958287 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f0a2b35b-c239-4770-8dce-94a2f32443dc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:35.959423 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f0a2b35b-c239-4770-8dce-94a2f32443dc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:35.966650 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f0a2b35b-c239-4770-8dce-94a2f32443dc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:35.967115 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f0a2b35b-c239-4770-8dce-94a2f32443dc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:35.967909 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f0a2b35b-c239-4770-8dce-94a2f32443dc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:35.968351 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f0a2b35b-c239-4770-8dce-94a2f32443dc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:36.119313 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f0a2b35b-c239-4770-8dce-94a2f32443dc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:36.130865 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f0a2b35b-c239-4770-8dce-94a2f32443dc tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9" status: 200 len: 1548 microversion: 2.1 time: 0.178948 Dec 15 14:16:36.131535 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 680/1330] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:35 2021] GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 => generated 1548 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:36.146792 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-30511038-3aee-4c9e-8d2e-8362912492d7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:36.147342 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-30511038-3aee-4c9e-8d2e-8362912492d7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:36.153732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-30511038-3aee-4c9e-8d2e-8362912492d7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:36.154256 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-30511038-3aee-4c9e-8d2e-8362912492d7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:36.155120 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-30511038-3aee-4c9e-8d2e-8362912492d7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:36.155623 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-30511038-3aee-4c9e-8d2e-8362912492d7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:36.245161 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-30511038-3aee-4c9e-8d2e-8362912492d7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101749 Dec 15 14:16:36.245823 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 681/1331] 10.222.0.42 () {58 vars in 1274 bytes} [Wed Dec 15 14:16:36 2021] GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:16:36.656951 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9f696be7-a66f-40c5-9451-552b37e8e67a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:36.657709 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9f696be7-a66f-40c5-9451-552b37e8e67a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:36.666137 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f696be7-a66f-40c5-9451-552b37e8e67a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:36.666786 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f696be7-a66f-40c5-9451-552b37e8e67a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:36.667956 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f696be7-a66f-40c5-9451-552b37e8e67a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:36.668626 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f696be7-a66f-40c5-9451-552b37e8e67a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:36.971994 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9f696be7-a66f-40c5-9451-552b37e8e67a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:36.982287 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9f696be7-a66f-40c5-9451-552b37e8e67a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.330752 Dec 15 14:16:36.982890 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 682/1332] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:36 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:37.466049 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9f154b18-71bc-402b-80bd-88030a47e59f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:37.466976 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9f154b18-71bc-402b-80bd-88030a47e59f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:37.473819 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f154b18-71bc-402b-80bd-88030a47e59f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:37.474278 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f154b18-71bc-402b-80bd-88030a47e59f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:37.475148 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f154b18-71bc-402b-80bd-88030a47e59f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:37.475799 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f154b18-71bc-402b-80bd-88030a47e59f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:37.549428 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9f154b18-71bc-402b-80bd-88030a47e59f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 14 microversion: 2.1 time: 0.086684 Dec 15 14:16:37.550226 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 683/1333] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:37 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:16:37.555485 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-1e9412ea-fc96-41b9-a56c-261ed8bf8fb0 req-5e2da90e-e925-439b-9171-5046f14b071e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9", "tag": "88814554-f9b3-47cc-bddd-5c6dc6942720"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:37.557394 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:16:37.557394 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:16:37.565908 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-1e9412ea-fc96-41b9-a56c-261ed8bf8fb0 req-5e2da90e-e925-439b-9171-5046f14b071e service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:37.566347 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-1e9412ea-fc96-41b9-a56c-261ed8bf8fb0 req-5e2da90e-e925-439b-9171-5046f14b071e service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:37.580217 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-1e9412ea-fc96-41b9-a56c-261ed8bf8fb0 req-5e2da90e-e925-439b-9171-5046f14b071e service nova] Creating event network-changed:88814554-f9b3-47cc-bddd-5c6dc6942720 for instance f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 on hv-cinder-82182 Dec 15 14:16:37.585477 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-1e9412ea-fc96-41b9-a56c-261ed8bf8fb0 req-5e2da90e-e925-439b-9171-5046f14b071e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033884 Dec 15 14:16:37.586486 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 684/1334] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:16:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:16:38.002357 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8c0eca67-6365-4bfc-9bc0-15ac0dd048b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:38.003165 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8c0eca67-6365-4bfc-9bc0-15ac0dd048b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:38.010287 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8c0eca67-6365-4bfc-9bc0-15ac0dd048b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:38.010840 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8c0eca67-6365-4bfc-9bc0-15ac0dd048b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:38.011738 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8c0eca67-6365-4bfc-9bc0-15ac0dd048b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:38.012243 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8c0eca67-6365-4bfc-9bc0-15ac0dd048b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:38.214717 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8c0eca67-6365-4bfc-9bc0-15ac0dd048b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:38.223035 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8c0eca67-6365-4bfc-9bc0-15ac0dd048b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.226213 Dec 15 14:16:38.223548 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 685/1335] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:37 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:38.560758 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-237ada4e-500a-4131-8f09-7f98f5d38bf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:38.561858 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-237ada4e-500a-4131-8f09-7f98f5d38bf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:38.569019 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-237ada4e-500a-4131-8f09-7f98f5d38bf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:38.569483 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-237ada4e-500a-4131-8f09-7f98f5d38bf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:38.570386 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-237ada4e-500a-4131-8f09-7f98f5d38bf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:38.570826 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-237ada4e-500a-4131-8f09-7f98f5d38bf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:38.646211 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-237ada4e-500a-4131-8f09-7f98f5d38bf7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 14 microversion: 2.1 time: 0.089109 Dec 15 14:16:38.647024 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 686/1336] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:38 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:16:39.245415 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-015e1739-fdb4-4e20-a4f1-c3554969628a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:39.246806 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-015e1739-fdb4-4e20-a4f1-c3554969628a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:39.257852 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-015e1739-fdb4-4e20-a4f1-c3554969628a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:39.258302 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-015e1739-fdb4-4e20-a4f1-c3554969628a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:39.259093 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-015e1739-fdb4-4e20-a4f1-c3554969628a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:39.259531 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-015e1739-fdb4-4e20-a4f1-c3554969628a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:39.417028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-015e1739-fdb4-4e20-a4f1-c3554969628a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:39.424693 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-015e1739-fdb4-4e20-a4f1-c3554969628a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.186429 Dec 15 14:16:39.425170 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 687/1337] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:39 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:39.657188 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9a994f1f-8c96-4f63-8c46-3b8c6318a9f3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:39.658145 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9a994f1f-8c96-4f63-8c46-3b8c6318a9f3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:39.666751 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a994f1f-8c96-4f63-8c46-3b8c6318a9f3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:39.667424 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a994f1f-8c96-4f63-8c46-3b8c6318a9f3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:39.668504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a994f1f-8c96-4f63-8c46-3b8c6318a9f3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:39.669432 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a994f1f-8c96-4f63-8c46-3b8c6318a9f3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:39.751696 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9a994f1f-8c96-4f63-8c46-3b8c6318a9f3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 14 microversion: 2.1 time: 0.097619 Dec 15 14:16:39.752575 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 688/1338] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:39 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:16:40.447658 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-81d58927-2037-4246-8569-7f81f105b234 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:40.449018 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-81d58927-2037-4246-8569-7f81f105b234 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:40.460063 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81d58927-2037-4246-8569-7f81f105b234 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:40.460504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81d58927-2037-4246-8569-7f81f105b234 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:40.461662 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81d58927-2037-4246-8569-7f81f105b234 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:40.462095 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81d58927-2037-4246-8569-7f81f105b234 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:40.605230 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-81d58927-2037-4246-8569-7f81f105b234 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:40.613015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-81d58927-2037-4246-8569-7f81f105b234 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.172678 Dec 15 14:16:40.613738 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 689/1339] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:40 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:40.767322 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-986df414-5519-4571-88bc-052520eef468 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:40.768320 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-986df414-5519-4571-88bc-052520eef468 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:40.779233 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-986df414-5519-4571-88bc-052520eef468 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:40.779793 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-986df414-5519-4571-88bc-052520eef468 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:40.780779 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-986df414-5519-4571-88bc-052520eef468 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:40.781789 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-986df414-5519-4571-88bc-052520eef468 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:40.862257 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-986df414-5519-4571-88bc-052520eef468 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 14 microversion: 2.1 time: 0.099071 Dec 15 14:16:40.863260 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 690/1340] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:40 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:16:41.635953 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-28249451-1ed3-41af-a460-ed76708fedaf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:41.637040 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-28249451-1ed3-41af-a460-ed76708fedaf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:41.648011 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-28249451-1ed3-41af-a460-ed76708fedaf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:41.648457 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-28249451-1ed3-41af-a460-ed76708fedaf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:41.649221 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-28249451-1ed3-41af-a460-ed76708fedaf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:41.649643 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-28249451-1ed3-41af-a460-ed76708fedaf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:41.802927 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-28249451-1ed3-41af-a460-ed76708fedaf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:41.810746 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-28249451-1ed3-41af-a460-ed76708fedaf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.182137 Dec 15 14:16:41.811324 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 691/1341] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:41 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:41.878999 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-576cfb76-4ee0-42a0-a184-0bc5b04a31a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:41.880484 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-576cfb76-4ee0-42a0-a184-0bc5b04a31a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:41.891394 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-576cfb76-4ee0-42a0-a184-0bc5b04a31a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:41.892045 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-576cfb76-4ee0-42a0-a184-0bc5b04a31a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:41.893355 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-576cfb76-4ee0-42a0-a184-0bc5b04a31a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:41.894183 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-576cfb76-4ee0-42a0-a184-0bc5b04a31a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:41.968311 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-576cfb76-4ee0-42a0-a184-0bc5b04a31a2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 14 microversion: 2.1 time: 0.094860 Dec 15 14:16:41.969316 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 692/1342] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:41 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:16:42.833190 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2ebaaa39-9511-4474-a0c1-0013aabda532 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:42.834654 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2ebaaa39-9511-4474-a0c1-0013aabda532 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:42.847320 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2ebaaa39-9511-4474-a0c1-0013aabda532 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:42.848070 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2ebaaa39-9511-4474-a0c1-0013aabda532 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:42.849373 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2ebaaa39-9511-4474-a0c1-0013aabda532 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:42.850776 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2ebaaa39-9511-4474-a0c1-0013aabda532 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:43.007315 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2ebaaa39-9511-4474-a0c1-0013aabda532 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:43.014807 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2ebaaa39-9511-4474-a0c1-0013aabda532 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.189359 Dec 15 14:16:43.015389 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 693/1343] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:42 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:43.019881 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-29387d31-083d-4a11-b5f4-61ccd922b6a6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:43.020782 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-29387d31-083d-4a11-b5f4-61ccd922b6a6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:43.026667 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-29387d31-083d-4a11-b5f4-61ccd922b6a6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:43.027111 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-29387d31-083d-4a11-b5f4-61ccd922b6a6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:43.027887 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-29387d31-083d-4a11-b5f4-61ccd922b6a6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:43.028315 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-29387d31-083d-4a11-b5f4-61ccd922b6a6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:43.099433 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-29387d31-083d-4a11-b5f4-61ccd922b6a6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 14 microversion: 2.1 time: 0.082752 Dec 15 14:16:43.100057 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 694/1344] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:43 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:16:44.035876 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0349898f-26b8-4758-8314-8608cca47862 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:44.036705 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0349898f-26b8-4758-8314-8608cca47862 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:44.046553 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0349898f-26b8-4758-8314-8608cca47862 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:44.047115 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0349898f-26b8-4758-8314-8608cca47862 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:44.048098 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0349898f-26b8-4758-8314-8608cca47862 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:44.048647 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0349898f-26b8-4758-8314-8608cca47862 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:44.208541 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0349898f-26b8-4758-8314-8608cca47862 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:44.216902 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0349898f-26b8-4758-8314-8608cca47862 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.186538 Dec 15 14:16:44.217522 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 695/1345] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:44 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:44.222062 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-75ea6a87-36d0-451a-beff-a8e9879bb1f7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:44.222970 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-75ea6a87-36d0-451a-beff-a8e9879bb1f7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:44.229277 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75ea6a87-36d0-451a-beff-a8e9879bb1f7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:44.229850 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75ea6a87-36d0-451a-beff-a8e9879bb1f7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:44.230639 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75ea6a87-36d0-451a-beff-a8e9879bb1f7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:44.231079 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75ea6a87-36d0-451a-beff-a8e9879bb1f7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:44.324299 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-75ea6a87-36d0-451a-beff-a8e9879bb1f7 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 14 microversion: 2.1 time: 0.104862 Dec 15 14:16:44.325199 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 696/1346] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:44 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:16:45.235698 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-423ca78c-e310-4ebf-8b8c-3291dda0c2fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:45.236371 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-423ca78c-e310-4ebf-8b8c-3291dda0c2fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:45.243936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-423ca78c-e310-4ebf-8b8c-3291dda0c2fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:45.244380 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-423ca78c-e310-4ebf-8b8c-3291dda0c2fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:45.245158 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-423ca78c-e310-4ebf-8b8c-3291dda0c2fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:45.245585 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-423ca78c-e310-4ebf-8b8c-3291dda0c2fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:45.390553 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-423ca78c-e310-4ebf-8b8c-3291dda0c2fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:45.399491 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-423ca78c-e310-4ebf-8b8c-3291dda0c2fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.168043 Dec 15 14:16:45.400057 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 697/1347] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:45 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:45.404534 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1d09a886-d1c0-40bf-a6e0-168a7e6a5335 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:45.405476 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1d09a886-d1c0-40bf-a6e0-168a7e6a5335 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:45.411329 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d09a886-d1c0-40bf-a6e0-168a7e6a5335 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:45.411776 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d09a886-d1c0-40bf-a6e0-168a7e6a5335 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:45.412571 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d09a886-d1c0-40bf-a6e0-168a7e6a5335 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:45.413547 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d09a886-d1c0-40bf-a6e0-168a7e6a5335 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:45.486386 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1d09a886-d1c0-40bf-a6e0-168a7e6a5335 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 14 microversion: 2.1 time: 0.084520 Dec 15 14:16:45.487026 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 698/1348] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:45 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:16:46.421668 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ec50de30-5446-4980-ba40-485c984c8bcc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:46.422941 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ec50de30-5446-4980-ba40-485c984c8bcc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:46.432945 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ec50de30-5446-4980-ba40-485c984c8bcc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:46.433389 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ec50de30-5446-4980-ba40-485c984c8bcc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:46.434187 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ec50de30-5446-4980-ba40-485c984c8bcc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:46.434613 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ec50de30-5446-4980-ba40-485c984c8bcc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:46.582969 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ec50de30-5446-4980-ba40-485c984c8bcc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:46.594802 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ec50de30-5446-4980-ba40-485c984c8bcc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.179449 Dec 15 14:16:46.595570 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 699/1349] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:46 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:46.600086 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fe54e3f4-8f51-4ccc-88dd-e5894decab89 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:46.601161 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fe54e3f4-8f51-4ccc-88dd-e5894decab89 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:46.607249 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fe54e3f4-8f51-4ccc-88dd-e5894decab89 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:46.607711 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fe54e3f4-8f51-4ccc-88dd-e5894decab89 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:46.608505 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fe54e3f4-8f51-4ccc-88dd-e5894decab89 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:46.608944 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fe54e3f4-8f51-4ccc-88dd-e5894decab89 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:46.686521 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fe54e3f4-8f51-4ccc-88dd-e5894decab89 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 14 microversion: 2.1 time: 0.089365 Dec 15 14:16:46.687233 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 700/1350] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:46 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:16:47.613060 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e2ad8a05-4ef2-4af9-af92-0d8b43754ab9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:47.613832 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e2ad8a05-4ef2-4af9-af92-0d8b43754ab9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:47.621304 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2ad8a05-4ef2-4af9-af92-0d8b43754ab9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:47.621798 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2ad8a05-4ef2-4af9-af92-0d8b43754ab9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:47.622580 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2ad8a05-4ef2-4af9-af92-0d8b43754ab9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:47.623017 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2ad8a05-4ef2-4af9-af92-0d8b43754ab9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:47.775713 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e2ad8a05-4ef2-4af9-af92-0d8b43754ab9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:47.783910 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e2ad8a05-4ef2-4af9-af92-0d8b43754ab9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.175077 Dec 15 14:16:47.784479 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 701/1351] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:47 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:47.788871 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-260d1d93-7ca2-4976-9200-747068ee444c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:47.790448 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-260d1d93-7ca2-4976-9200-747068ee444c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:47.796270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-260d1d93-7ca2-4976-9200-747068ee444c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:47.796719 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-260d1d93-7ca2-4976-9200-747068ee444c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:47.797498 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-260d1d93-7ca2-4976-9200-747068ee444c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:47.797959 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-260d1d93-7ca2-4976-9200-747068ee444c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:47.879532 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-260d1d93-7ca2-4976-9200-747068ee444c tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 7937 microversion: 2.1 time: 0.093247 Dec 15 14:16:47.880408 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 702/1352] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:47 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 7937 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:48.804219 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-286fc1e2-3c85-4879-80fe-0a7c08e9d10c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:48.804902 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-286fc1e2-3c85-4879-80fe-0a7c08e9d10c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:48.812630 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-286fc1e2-3c85-4879-80fe-0a7c08e9d10c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:48.813077 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-286fc1e2-3c85-4879-80fe-0a7c08e9d10c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:48.813879 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-286fc1e2-3c85-4879-80fe-0a7c08e9d10c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:48.814297 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-286fc1e2-3c85-4879-80fe-0a7c08e9d10c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:48.987999 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-286fc1e2-3c85-4879-80fe-0a7c08e9d10c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:48.996297 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-286fc1e2-3c85-4879-80fe-0a7c08e9d10c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.196037 Dec 15 14:16:48.996889 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 703/1353] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:48 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:49.001390 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-42fa98b4-8ca8-4311-81dd-d09e0241e10f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:49.002339 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-42fa98b4-8ca8-4311-81dd-d09e0241e10f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:49.008830 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42fa98b4-8ca8-4311-81dd-d09e0241e10f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:49.009262 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42fa98b4-8ca8-4311-81dd-d09e0241e10f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:49.010229 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42fa98b4-8ca8-4311-81dd-d09e0241e10f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:49.011408 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42fa98b4-8ca8-4311-81dd-d09e0241e10f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:49.102614 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-42fa98b4-8ca8-4311-81dd-d09e0241e10f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 16721 microversion: 2.1 time: 0.104221 Dec 15 14:16:49.103362 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 704/1354] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:48 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 16721 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:16:49.463274 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:16:49.464148 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:16:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/os-volume_attachments/7267792b-a221-4709-9588-a9838e8b0eec (ip 10.222.0.42) !!! Dec 15 14:16:50.018934 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4fc9f276-bcca-417e-a6ea-f30ed8be0612 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:50.020116 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4fc9f276-bcca-417e-a6ea-f30ed8be0612 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:50.029015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4fc9f276-bcca-417e-a6ea-f30ed8be0612 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:50.029463 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4fc9f276-bcca-417e-a6ea-f30ed8be0612 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:50.030270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4fc9f276-bcca-417e-a6ea-f30ed8be0612 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:50.030702 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4fc9f276-bcca-417e-a6ea-f30ed8be0612 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:50.184691 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4fc9f276-bcca-417e-a6ea-f30ed8be0612 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:50.196535 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4fc9f276-bcca-417e-a6ea-f30ed8be0612 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.184609 Dec 15 14:16:50.197102 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 705/1355] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:50 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:50.201507 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-47cab59b-f9af-482d-b875-d6e1d964a177 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:50.202430 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-47cab59b-f9af-482d-b875-d6e1d964a177 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:50.208263 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47cab59b-f9af-482d-b875-d6e1d964a177 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:50.208744 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47cab59b-f9af-482d-b875-d6e1d964a177 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:50.209633 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47cab59b-f9af-482d-b875-d6e1d964a177 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:50.210058 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47cab59b-f9af-482d-b875-d6e1d964a177 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:50.290786 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-47cab59b-f9af-482d-b875-d6e1d964a177 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 18871 microversion: 2.1 time: 0.092480 Dec 15 14:16:50.291447 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 706/1356] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:50 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 18871 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:16:51.032212 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:16:51.033078 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:16:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/os-volume_attachments/7267792b-a221-4709-9588-a9838e8b0eec (ip 10.222.0.42) !!! Dec 15 14:16:51.215021 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5296a15a-b0b4-44a7-afda-1f5f321baff5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:51.215718 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5296a15a-b0b4-44a7-afda-1f5f321baff5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:51.223030 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5296a15a-b0b4-44a7-afda-1f5f321baff5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:51.223478 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5296a15a-b0b4-44a7-afda-1f5f321baff5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:51.224255 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5296a15a-b0b4-44a7-afda-1f5f321baff5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:51.224684 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5296a15a-b0b4-44a7-afda-1f5f321baff5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:51.378981 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5296a15a-b0b4-44a7-afda-1f5f321baff5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:51.386732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5296a15a-b0b4-44a7-afda-1f5f321baff5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.176173 Dec 15 14:16:51.387300 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 707/1357] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:51 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:51.391583 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cdf3c272-88a4-4ed9-b861-60745ad851a6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:51.392486 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cdf3c272-88a4-4ed9-b861-60745ad851a6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:51.398167 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cdf3c272-88a4-4ed9-b861-60745ad851a6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:51.398618 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cdf3c272-88a4-4ed9-b861-60745ad851a6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:51.399683 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cdf3c272-88a4-4ed9-b861-60745ad851a6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:51.400127 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cdf3c272-88a4-4ed9-b861-60745ad851a6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:51.480155 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cdf3c272-88a4-4ed9-b861-60745ad851a6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 21674 microversion: 2.1 time: 0.091193 Dec 15 14:16:51.481171 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 708/1358] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:51 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 21674 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:16:52.408145 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-edda95be-4085-491b-925c-dc8759432f38 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:52.409278 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-edda95be-4085-491b-925c-dc8759432f38 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:52.419041 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-edda95be-4085-491b-925c-dc8759432f38 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:52.419482 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-edda95be-4085-491b-925c-dc8759432f38 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:52.420252 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-edda95be-4085-491b-925c-dc8759432f38 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:52.420665 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-edda95be-4085-491b-925c-dc8759432f38 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:52.568211 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-edda95be-4085-491b-925c-dc8759432f38 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:52.575915 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-edda95be-4085-491b-925c-dc8759432f38 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.174713 Dec 15 14:16:52.576496 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 709/1359] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:52 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:52.581010 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5b6228c2-6d01-4593-98a6-872e9de7e6e1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:52.581944 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5b6228c2-6d01-4593-98a6-872e9de7e6e1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:52.588703 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b6228c2-6d01-4593-98a6-872e9de7e6e1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:52.589146 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b6228c2-6d01-4593-98a6-872e9de7e6e1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:52.589953 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b6228c2-6d01-4593-98a6-872e9de7e6e1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:52.590383 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b6228c2-6d01-4593-98a6-872e9de7e6e1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:52.670401 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5b6228c2-6d01-4593-98a6-872e9de7e6e1 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 23235 microversion: 2.1 time: 0.092043 Dec 15 14:16:52.671322 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 710/1360] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:52 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 23235 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:16:53.596706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1d1f469b-f1e9-45e0-8bd1-9fed5c02f8b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:53.597651 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1d1f469b-f1e9-45e0-8bd1-9fed5c02f8b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:53.607334 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d1f469b-f1e9-45e0-8bd1-9fed5c02f8b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:53.607918 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d1f469b-f1e9-45e0-8bd1-9fed5c02f8b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:53.608951 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d1f469b-f1e9-45e0-8bd1-9fed5c02f8b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:53.609565 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d1f469b-f1e9-45e0-8bd1-9fed5c02f8b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:53.754443 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1d1f469b-f1e9-45e0-8bd1-9fed5c02f8b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:53.764950 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1d1f469b-f1e9-45e0-8bd1-9fed5c02f8b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.173667 Dec 15 14:16:53.765508 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 711/1361] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:53 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:53.770637 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-96a542e4-2678-41d4-b3e8-d0b7497d4b08 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:53.772040 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-96a542e4-2678-41d4-b3e8-d0b7497d4b08 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:53.778463 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96a542e4-2678-41d4-b3e8-d0b7497d4b08 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:53.778916 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96a542e4-2678-41d4-b3e8-d0b7497d4b08 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:53.779708 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96a542e4-2678-41d4-b3e8-d0b7497d4b08 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:53.780141 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96a542e4-2678-41d4-b3e8-d0b7497d4b08 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:53.860963 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-96a542e4-2678-41d4-b3e8-d0b7497d4b08 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 24926 microversion: 2.1 time: 0.093827 Dec 15 14:16:53.861719 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 712/1362] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:53 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 24926 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:16:54.784266 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c33d48e3-8ea8-4236-8b65-b5ac4ff57f2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:54.784974 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c33d48e3-8ea8-4236-8b65-b5ac4ff57f2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:54.792825 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c33d48e3-8ea8-4236-8b65-b5ac4ff57f2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:54.793267 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c33d48e3-8ea8-4236-8b65-b5ac4ff57f2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:54.794091 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c33d48e3-8ea8-4236-8b65-b5ac4ff57f2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:54.794520 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c33d48e3-8ea8-4236-8b65-b5ac4ff57f2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:54.942319 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c33d48e3-8ea8-4236-8b65-b5ac4ff57f2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:54.951390 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c33d48e3-8ea8-4236-8b65-b5ac4ff57f2e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.171310 Dec 15 14:16:54.952021 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 713/1363] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:54 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:54.956394 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-90b9bdbd-d6a3-431d-b9f0-7e22cd6a5fb5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:54.957327 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-90b9bdbd-d6a3-431d-b9f0-7e22cd6a5fb5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:54.963468 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90b9bdbd-d6a3-431d-b9f0-7e22cd6a5fb5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:54.963916 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90b9bdbd-d6a3-431d-b9f0-7e22cd6a5fb5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:54.964695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90b9bdbd-d6a3-431d-b9f0-7e22cd6a5fb5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:54.965125 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90b9bdbd-d6a3-431d-b9f0-7e22cd6a5fb5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:55.045884 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-90b9bdbd-d6a3-431d-b9f0-7e22cd6a5fb5 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 26613 microversion: 2.1 time: 0.092143 Dec 15 14:16:55.046587 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 714/1364] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:54 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 26613 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:16:55.974015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e217403e-cdfa-4cc8-92f6-cc466e40dbcc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:55.975072 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e217403e-cdfa-4cc8-92f6-cc466e40dbcc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:55.984461 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e217403e-cdfa-4cc8-92f6-cc466e40dbcc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:55.984926 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e217403e-cdfa-4cc8-92f6-cc466e40dbcc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:55.985732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e217403e-cdfa-4cc8-92f6-cc466e40dbcc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:55.986166 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e217403e-cdfa-4cc8-92f6-cc466e40dbcc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:56.127673 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e217403e-cdfa-4cc8-92f6-cc466e40dbcc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:56.138226 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e217403e-cdfa-4cc8-92f6-cc466e40dbcc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.171015 Dec 15 14:16:56.138893 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 715/1365] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:55 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:56.143331 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cc3e67f3-4e7d-45f3-9511-6fff7a893bbb tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:56.144245 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cc3e67f3-4e7d-45f3-9511-6fff7a893bbb tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:56.150215 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cc3e67f3-4e7d-45f3-9511-6fff7a893bbb tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:56.150809 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cc3e67f3-4e7d-45f3-9511-6fff7a893bbb tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:56.151564 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cc3e67f3-4e7d-45f3-9511-6fff7a893bbb tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:56.152005 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cc3e67f3-4e7d-45f3-9511-6fff7a893bbb tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:56.239281 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cc3e67f3-4e7d-45f3-9511-6fff7a893bbb tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 27662 microversion: 2.1 time: 0.098756 Dec 15 14:16:56.240310 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 716/1366] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:56 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 27662 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:16:57.160372 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1a74a3ba-cb6f-4178-9bf7-7b5a0a0f1636 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:57.161282 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1a74a3ba-cb6f-4178-9bf7-7b5a0a0f1636 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:57.170613 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1a74a3ba-cb6f-4178-9bf7-7b5a0a0f1636 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:57.171176 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1a74a3ba-cb6f-4178-9bf7-7b5a0a0f1636 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:57.172153 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1a74a3ba-cb6f-4178-9bf7-7b5a0a0f1636 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:57.172706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1a74a3ba-cb6f-4178-9bf7-7b5a0a0f1636 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:57.329009 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1a74a3ba-cb6f-4178-9bf7-7b5a0a0f1636 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:57.336974 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1a74a3ba-cb6f-4178-9bf7-7b5a0a0f1636 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.181774 Dec 15 14:16:57.337518 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 717/1367] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:57 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:57.342527 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-48e1ff0a-462c-47c5-b165-6b02c30088bf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:57.343430 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-48e1ff0a-462c-47c5-b165-6b02c30088bf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:57.349065 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48e1ff0a-462c-47c5-b165-6b02c30088bf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:57.349518 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48e1ff0a-462c-47c5-b165-6b02c30088bf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:57.350326 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48e1ff0a-462c-47c5-b165-6b02c30088bf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:57.350758 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48e1ff0a-462c-47c5-b165-6b02c30088bf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:57.456308 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-48e1ff0a-462c-47c5-b165-6b02c30088bf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 28023 microversion: 2.1 time: 0.116958 Dec 15 14:16:57.457189 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 718/1368] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:57 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 28023 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:16:58.357400 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c2347dff-e6db-46d7-aec3-0e13851c20ae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:58.358318 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c2347dff-e6db-46d7-aec3-0e13851c20ae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:58.365454 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c2347dff-e6db-46d7-aec3-0e13851c20ae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:58.365927 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c2347dff-e6db-46d7-aec3-0e13851c20ae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:58.366698 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c2347dff-e6db-46d7-aec3-0e13851c20ae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:58.367137 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c2347dff-e6db-46d7-aec3-0e13851c20ae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:58.538033 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c2347dff-e6db-46d7-aec3-0e13851c20ae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:58.546682 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c2347dff-e6db-46d7-aec3-0e13851c20ae tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.194918 Dec 15 14:16:58.547265 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 719/1369] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:58 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:58.551630 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-13c974ad-d56b-4cb9-be79-53d4dc42a8d9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:58.552556 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-13c974ad-d56b-4cb9-be79-53d4dc42a8d9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:58.558732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13c974ad-d56b-4cb9-be79-53d4dc42a8d9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:58.559176 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13c974ad-d56b-4cb9-be79-53d4dc42a8d9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:58.559983 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13c974ad-d56b-4cb9-be79-53d4dc42a8d9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:58.560441 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13c974ad-d56b-4cb9-be79-53d4dc42a8d9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:58.643661 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-13c974ad-d56b-4cb9-be79-53d4dc42a8d9 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 28207 microversion: 2.1 time: 0.094606 Dec 15 14:16:58.644550 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 720/1370] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:58 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 28207 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:16:59.567467 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-031c040f-3a70-4ea0-8057-580744a53d7c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:59.568155 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-031c040f-3a70-4ea0-8057-580744a53d7c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:59.577048 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-031c040f-3a70-4ea0-8057-580744a53d7c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:59.577510 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-031c040f-3a70-4ea0-8057-580744a53d7c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:59.578311 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-031c040f-3a70-4ea0-8057-580744a53d7c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:59.578714 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-031c040f-3a70-4ea0-8057-580744a53d7c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:59.734037 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-031c040f-3a70-4ea0-8057-580744a53d7c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:59.746922 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-031c040f-3a70-4ea0-8057-580744a53d7c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.184946 Dec 15 14:16:59.747929 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 721/1371] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:59 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:59.753543 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d9d6f331-7c8c-471e-a7c6-521a51c89b7d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:59.754471 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d9d6f331-7c8c-471e-a7c6-521a51c89b7d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:59.760530 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9d6f331-7c8c-471e-a7c6-521a51c89b7d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:59.761066 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9d6f331-7c8c-471e-a7c6-521a51c89b7d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:59.761877 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9d6f331-7c8c-471e-a7c6-521a51c89b7d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:59.762331 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9d6f331-7c8c-471e-a7c6-521a51c89b7d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:59.854901 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d9d6f331-7c8c-471e-a7c6-521a51c89b7d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 28207 microversion: 2.1 time: 0.104731 Dec 15 14:16:59.856015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 722/1372] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:59 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 28207 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:17:00.770930 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-251053c4-e66c-4c2d-981f-74faea858d33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:00.772119 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-251053c4-e66c-4c2d-981f-74faea858d33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:00.781366 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-251053c4-e66c-4c2d-981f-74faea858d33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:00.781855 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-251053c4-e66c-4c2d-981f-74faea858d33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:00.782674 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-251053c4-e66c-4c2d-981f-74faea858d33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:00.783161 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-251053c4-e66c-4c2d-981f-74faea858d33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:00.930781 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-251053c4-e66c-4c2d-981f-74faea858d33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:00.939014 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-251053c4-e66c-4c2d-981f-74faea858d33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.175165 Dec 15 14:17:00.939557 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 723/1373] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:00 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:00.944154 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4ca6563f-b034-49cc-94e2-6cd3c85b0ac6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:00.945090 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4ca6563f-b034-49cc-94e2-6cd3c85b0ac6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:00.951089 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ca6563f-b034-49cc-94e2-6cd3c85b0ac6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:00.951550 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ca6563f-b034-49cc-94e2-6cd3c85b0ac6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:00.952321 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ca6563f-b034-49cc-94e2-6cd3c85b0ac6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:00.952749 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ca6563f-b034-49cc-94e2-6cd3c85b0ac6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:01.046703 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4ca6563f-b034-49cc-94e2-6cd3c85b0ac6 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 28207 microversion: 2.1 time: 0.105579 Dec 15 14:17:01.047568 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 724/1374] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:17:00 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 28207 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:17:01.961051 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e43e740a-cc1f-4b2a-8671-e08dd25020f3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:01.962181 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e43e740a-cc1f-4b2a-8671-e08dd25020f3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:01.974251 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e43e740a-cc1f-4b2a-8671-e08dd25020f3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:01.975005 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e43e740a-cc1f-4b2a-8671-e08dd25020f3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:01.976295 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e43e740a-cc1f-4b2a-8671-e08dd25020f3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:01.977029 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e43e740a-cc1f-4b2a-8671-e08dd25020f3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:02.136038 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e43e740a-cc1f-4b2a-8671-e08dd25020f3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:02.146259 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e43e740a-cc1f-4b2a-8671-e08dd25020f3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.192017 Dec 15 14:17:02.146977 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 725/1375] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:01 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:02.151444 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d28070f7-3279-45f2-895d-bfbf66e524e4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:02.152626 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d28070f7-3279-45f2-895d-bfbf66e524e4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:02.159570 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d28070f7-3279-45f2-895d-bfbf66e524e4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:02.160224 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d28070f7-3279-45f2-895d-bfbf66e524e4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:02.161294 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d28070f7-3279-45f2-895d-bfbf66e524e4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:02.161884 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d28070f7-3279-45f2-895d-bfbf66e524e4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:02.244912 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d28070f7-3279-45f2-895d-bfbf66e524e4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 28207 microversion: 2.1 time: 0.096561 Dec 15 14:17:02.245936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 726/1376] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:17:02 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 28207 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:17:03.169977 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-db842c8f-d390-45d2-a351-7fadf76d5b0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:03.171058 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-db842c8f-d390-45d2-a351-7fadf76d5b0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:03.182773 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db842c8f-d390-45d2-a351-7fadf76d5b0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:03.183576 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db842c8f-d390-45d2-a351-7fadf76d5b0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:03.185058 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db842c8f-d390-45d2-a351-7fadf76d5b0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:03.185501 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db842c8f-d390-45d2-a351-7fadf76d5b0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:03.343856 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-db842c8f-d390-45d2-a351-7fadf76d5b0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:03.355391 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-db842c8f-d390-45d2-a351-7fadf76d5b0a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.192552 Dec 15 14:17:03.356150 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 727/1377] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:03 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:03.360619 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-527badf2-6f88-45d5-b3f4-836574932f20 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:03.361563 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-527badf2-6f88-45d5-b3f4-836574932f20 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:03.367257 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-527badf2-6f88-45d5-b3f4-836574932f20 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:03.367851 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-527badf2-6f88-45d5-b3f4-836574932f20 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:03.368636 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-527badf2-6f88-45d5-b3f4-836574932f20 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:03.369075 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-527badf2-6f88-45d5-b3f4-836574932f20 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:03.447116 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-527badf2-6f88-45d5-b3f4-836574932f20 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 28207 microversion: 2.1 time: 0.089613 Dec 15 14:17:03.447669 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 728/1378] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:17:03 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 28207 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:17:04.376777 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cf6fe07b-af8c-4b1b-be09-4a3488e9cd3b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:04.377500 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cf6fe07b-af8c-4b1b-be09-4a3488e9cd3b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:04.385643 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf6fe07b-af8c-4b1b-be09-4a3488e9cd3b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:04.386184 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf6fe07b-af8c-4b1b-be09-4a3488e9cd3b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:04.387056 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf6fe07b-af8c-4b1b-be09-4a3488e9cd3b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:04.387547 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf6fe07b-af8c-4b1b-be09-4a3488e9cd3b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:04.549076 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cf6fe07b-af8c-4b1b-be09-4a3488e9cd3b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:04.557251 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cf6fe07b-af8c-4b1b-be09-4a3488e9cd3b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.187100 Dec 15 14:17:04.557908 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 729/1379] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:04 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:04.563269 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-95a2f5ea-d925-45a5-8878-023f1d1f2296 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:04.564184 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-95a2f5ea-d925-45a5-8878-023f1d1f2296 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:04.570105 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-95a2f5ea-d925-45a5-8878-023f1d1f2296 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:04.570554 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-95a2f5ea-d925-45a5-8878-023f1d1f2296 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:04.571340 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-95a2f5ea-d925-45a5-8878-023f1d1f2296 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:04.571775 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-95a2f5ea-d925-45a5-8878-023f1d1f2296 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:04.653668 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-95a2f5ea-d925-45a5-8878-023f1d1f2296 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 28207 microversion: 2.1 time: 0.094370 Dec 15 14:17:04.654228 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 730/1380] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:17:04 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 28207 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:17:05.576986 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4d0686fe-be9f-4529-9f16-f2e19d594cec tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:05.577550 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4d0686fe-be9f-4529-9f16-f2e19d594cec tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:05.584597 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4d0686fe-be9f-4529-9f16-f2e19d594cec tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:05.585050 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4d0686fe-be9f-4529-9f16-f2e19d594cec tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:05.586195 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4d0686fe-be9f-4529-9f16-f2e19d594cec tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:05.586628 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4d0686fe-be9f-4529-9f16-f2e19d594cec tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:05.733258 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4d0686fe-be9f-4529-9f16-f2e19d594cec tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:05.741045 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4d0686fe-be9f-4529-9f16-f2e19d594cec tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.169136 Dec 15 14:17:05.741633 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 731/1381] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:05 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:05.746801 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-537eda7c-1732-4db2-a9eb-9ea9b061424f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:05.747002 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-537eda7c-1732-4db2-a9eb-9ea9b061424f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:05.752608 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-537eda7c-1732-4db2-a9eb-9ea9b061424f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:05.753074 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-537eda7c-1732-4db2-a9eb-9ea9b061424f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:05.753886 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-537eda7c-1732-4db2-a9eb-9ea9b061424f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:05.754324 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-537eda7c-1732-4db2-a9eb-9ea9b061424f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:05.828984 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-537eda7c-1732-4db2-a9eb-9ea9b061424f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 28207 microversion: 2.1 time: 0.086105 Dec 15 14:17:05.829657 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 732/1382] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:17:05 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 28207 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:17:06.763662 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-94d8abab-104c-42ee-be78-a6fd9f695091 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:06.765014 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-94d8abab-104c-42ee-be78-a6fd9f695091 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:06.778077 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-94d8abab-104c-42ee-be78-a6fd9f695091 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:06.778876 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-94d8abab-104c-42ee-be78-a6fd9f695091 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:06.780225 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-94d8abab-104c-42ee-be78-a6fd9f695091 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:06.780671 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-94d8abab-104c-42ee-be78-a6fd9f695091 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:06.936741 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-94d8abab-104c-42ee-be78-a6fd9f695091 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:06.945939 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-94d8abab-104c-42ee-be78-a6fd9f695091 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.189326 Dec 15 14:17:06.946508 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 733/1383] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:06 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:06.950838 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1a064f21-2261-43ca-b83d-b73cf2dddeac tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:06.951788 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1a064f21-2261-43ca-b83d-b73cf2dddeac tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:06.958014 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1a064f21-2261-43ca-b83d-b73cf2dddeac tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:06.958462 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1a064f21-2261-43ca-b83d-b73cf2dddeac tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:06.959230 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1a064f21-2261-43ca-b83d-b73cf2dddeac tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:06.959657 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1a064f21-2261-43ca-b83d-b73cf2dddeac tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:07.066619 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1a064f21-2261-43ca-b83d-b73cf2dddeac tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 28207 microversion: 2.1 time: 0.118060 Dec 15 14:17:07.067679 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 734/1384] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:17:06 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 28207 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:17:07.969511 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d512df41-6ada-42f3-afd9-2013cf743e97 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:07.970665 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d512df41-6ada-42f3-afd9-2013cf743e97 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:07.982453 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d512df41-6ada-42f3-afd9-2013cf743e97 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:07.983196 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d512df41-6ada-42f3-afd9-2013cf743e97 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:07.984595 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d512df41-6ada-42f3-afd9-2013cf743e97 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:07.985127 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d512df41-6ada-42f3-afd9-2013cf743e97 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:08.144104 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d512df41-6ada-42f3-afd9-2013cf743e97 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:08.152224 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d512df41-6ada-42f3-afd9-2013cf743e97 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.189904 Dec 15 14:17:08.152833 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 735/1385] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:07 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:08.157437 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3576fd47-9934-42ee-8da8-b5471de0438a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:08.158409 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3576fd47-9934-42ee-8da8-b5471de0438a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:08.164323 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3576fd47-9934-42ee-8da8-b5471de0438a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:08.164796 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3576fd47-9934-42ee-8da8-b5471de0438a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:08.165577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3576fd47-9934-42ee-8da8-b5471de0438a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:08.166034 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3576fd47-9934-42ee-8da8-b5471de0438a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:08.247741 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3576fd47-9934-42ee-8da8-b5471de0438a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 28207 microversion: 2.1 time: 0.093296 Dec 15 14:17:08.248499 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 736/1386] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:17:08 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 28207 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:17:09.173666 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8eb63083-348e-4d08-959a-538cab24cd08 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:09.174496 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8eb63083-348e-4d08-959a-538cab24cd08 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:09.182898 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8eb63083-348e-4d08-959a-538cab24cd08 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:09.183403 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8eb63083-348e-4d08-959a-538cab24cd08 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:09.184287 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8eb63083-348e-4d08-959a-538cab24cd08 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:09.184774 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8eb63083-348e-4d08-959a-538cab24cd08 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:09.336263 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8eb63083-348e-4d08-959a-538cab24cd08 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:09.347744 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8eb63083-348e-4d08-959a-538cab24cd08 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.180573 Dec 15 14:17:09.348505 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 737/1387] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:09 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:09.353141 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-231b446d-f0ad-4557-b7c7-b6d11c5453cf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:09.354110 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-231b446d-f0ad-4557-b7c7-b6d11c5453cf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:09.360889 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-231b446d-f0ad-4557-b7c7-b6d11c5453cf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:09.361327 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-231b446d-f0ad-4557-b7c7-b6d11c5453cf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:09.362154 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-231b446d-f0ad-4557-b7c7-b6d11c5453cf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:09.362594 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-231b446d-f0ad-4557-b7c7-b6d11c5453cf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:09.439640 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-231b446d-f0ad-4557-b7c7-b6d11c5453cf tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 28207 microversion: 2.1 time: 0.089432 Dec 15 14:17:09.440452 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 738/1388] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:17:09 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 28207 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:17:10.366186 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-83031443-2f22-44a3-abfc-9f80c4f700d2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:10.366927 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-83031443-2f22-44a3-abfc-9f80c4f700d2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:10.377835 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83031443-2f22-44a3-abfc-9f80c4f700d2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:10.378288 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83031443-2f22-44a3-abfc-9f80c4f700d2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:10.379631 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83031443-2f22-44a3-abfc-9f80c4f700d2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:10.380087 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83031443-2f22-44a3-abfc-9f80c4f700d2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:10.542305 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-83031443-2f22-44a3-abfc-9f80c4f700d2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:10.554293 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-83031443-2f22-44a3-abfc-9f80c4f700d2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.192720 Dec 15 14:17:10.555032 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 739/1389] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:10 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:10.559515 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d48972fd-2884-466f-9c88-51bb0718b186 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:10.560427 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d48972fd-2884-466f-9c88-51bb0718b186 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:10.566740 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d48972fd-2884-466f-9c88-51bb0718b186 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:10.567202 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d48972fd-2884-466f-9c88-51bb0718b186 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:10.567977 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d48972fd-2884-466f-9c88-51bb0718b186 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:10.568412 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d48972fd-2884-466f-9c88-51bb0718b186 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:10.647688 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d48972fd-2884-466f-9c88-51bb0718b186 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 28207 microversion: 2.1 time: 0.090713 Dec 15 14:17:10.648550 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 740/1390] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:17:10 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 28207 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:17:11.365432 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:17:11.366405 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:17:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/os-volume_attachments/7267792b-a221-4709-9588-a9838e8b0eec (ip 10.222.0.42) !!! Dec 15 14:17:11.574055 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3731f127-4187-43b3-88e2-4792094cca0b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:11.574761 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3731f127-4187-43b3-88e2-4792094cca0b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:11.582848 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3731f127-4187-43b3-88e2-4792094cca0b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:11.583307 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3731f127-4187-43b3-88e2-4792094cca0b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:11.584098 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3731f127-4187-43b3-88e2-4792094cca0b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:11.584534 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3731f127-4187-43b3-88e2-4792094cca0b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:11.740636 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3731f127-4187-43b3-88e2-4792094cca0b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:11.752825 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3731f127-4187-43b3-88e2-4792094cca0b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.183044 Dec 15 14:17:11.753602 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 741/1391] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:11 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:11.760400 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7c316f69-9e2e-4d4c-8108-74c7bf7a6a55 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:11.761596 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7c316f69-9e2e-4d4c-8108-74c7bf7a6a55 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:11.767663 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7c316f69-9e2e-4d4c-8108-74c7bf7a6a55 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:11.768107 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7c316f69-9e2e-4d4c-8108-74c7bf7a6a55 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:11.769305 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7c316f69-9e2e-4d4c-8108-74c7bf7a6a55 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:11.769968 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7c316f69-9e2e-4d4c-8108-74c7bf7a6a55 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:11.851520 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7c316f69-9e2e-4d4c-8108-74c7bf7a6a55 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 28498 microversion: 2.1 time: 0.096158 Dec 15 14:17:11.852380 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 742/1392] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:17:11 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 28498 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:17:12.777672 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c29d138b-13c8-4188-85c9-597b9cd6a84f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:12.778887 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c29d138b-13c8-4188-85c9-597b9cd6a84f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:12.787561 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c29d138b-13c8-4188-85c9-597b9cd6a84f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:12.788002 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c29d138b-13c8-4188-85c9-597b9cd6a84f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:12.788778 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c29d138b-13c8-4188-85c9-597b9cd6a84f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:12.789202 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c29d138b-13c8-4188-85c9-597b9cd6a84f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:12.929355 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c29d138b-13c8-4188-85c9-597b9cd6a84f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:12.942986 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c29d138b-13c8-4188-85c9-597b9cd6a84f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.171846 Dec 15 14:17:12.943887 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 743/1393] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:12 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:12.950781 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5681e67a-cb8d-4250-8a2b-90daaf625d9f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:12.952170 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5681e67a-cb8d-4250-8a2b-90daaf625d9f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:12.959224 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5681e67a-cb8d-4250-8a2b-90daaf625d9f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:12.959684 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5681e67a-cb8d-4250-8a2b-90daaf625d9f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:12.960822 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5681e67a-cb8d-4250-8a2b-90daaf625d9f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:12.961261 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5681e67a-cb8d-4250-8a2b-90daaf625d9f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:13.039512 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5681e67a-cb8d-4250-8a2b-90daaf625d9f tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 28498 microversion: 2.1 time: 0.093575 Dec 15 14:17:13.040303 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 744/1394] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:17:12 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 28498 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:17:13.965417 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d4a36869-73c4-45e5-9e3e-17106fda7ce8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:13.966168 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d4a36869-73c4-45e5-9e3e-17106fda7ce8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:13.974263 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4a36869-73c4-45e5-9e3e-17106fda7ce8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:13.974736 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4a36869-73c4-45e5-9e3e-17106fda7ce8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:13.975524 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4a36869-73c4-45e5-9e3e-17106fda7ce8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:13.975951 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4a36869-73c4-45e5-9e3e-17106fda7ce8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:14.131326 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d4a36869-73c4-45e5-9e3e-17106fda7ce8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:14.139339 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d4a36869-73c4-45e5-9e3e-17106fda7ce8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.178022 Dec 15 14:17:14.139932 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 745/1395] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:13 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:14.144968 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-45403f19-6217-4ff8-9578-3db150546248 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:14.145948 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-45403f19-6217-4ff8-9578-3db150546248 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:14.153119 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45403f19-6217-4ff8-9578-3db150546248 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:14.153908 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45403f19-6217-4ff8-9578-3db150546248 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:14.155062 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45403f19-6217-4ff8-9578-3db150546248 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:14.155703 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45403f19-6217-4ff8-9578-3db150546248 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:14.239803 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-45403f19-6217-4ff8-9578-3db150546248 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 28666 microversion: 2.1 time: 0.098446 Dec 15 14:17:14.240574 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 746/1396] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:17:14 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 28666 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:17:15.161489 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-15a7344e-5bb0-436f-b7a3-f6e144af33f4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:15.162539 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-15a7344e-5bb0-436f-b7a3-f6e144af33f4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:15.173144 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15a7344e-5bb0-436f-b7a3-f6e144af33f4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:15.173861 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15a7344e-5bb0-436f-b7a3-f6e144af33f4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:15.175071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15a7344e-5bb0-436f-b7a3-f6e144af33f4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:15.175623 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15a7344e-5bb0-436f-b7a3-f6e144af33f4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:15.316177 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-15a7344e-5bb0-436f-b7a3-f6e144af33f4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:15.328252 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-15a7344e-5bb0-436f-b7a3-f6e144af33f4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.173246 Dec 15 14:17:15.329104 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 747/1397] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:15 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:15.334277 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-964c2562-011f-40ff-a59d-a0802d753edd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:15.335553 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-964c2562-011f-40ff-a59d-a0802d753edd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:15.341400 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-964c2562-011f-40ff-a59d-a0802d753edd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:15.341894 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-964c2562-011f-40ff-a59d-a0802d753edd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:15.342690 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-964c2562-011f-40ff-a59d-a0802d753edd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:15.343130 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-964c2562-011f-40ff-a59d-a0802d753edd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:15.423845 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-964c2562-011f-40ff-a59d-a0802d753edd tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 28666 microversion: 2.1 time: 0.093155 Dec 15 14:17:15.425109 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 748/1398] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:17:15 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 28666 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:17:15.625881 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8a59e402-5a1c-44a3-8b30-4cee392860a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:15.626837 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8a59e402-5a1c-44a3-8b30-4cee392860a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:15.634675 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a59e402-5a1c-44a3-8b30-4cee392860a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:15.635131 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a59e402-5a1c-44a3-8b30-4cee392860a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:15.635918 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a59e402-5a1c-44a3-8b30-4cee392860a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:15.636352 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a59e402-5a1c-44a3-8b30-4cee392860a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:15.951467 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-798c02de-c8f0-4097-9efa-500c017094da tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/os-volume_attachments/7267792b-a221-4709-9588-a9838e8b0eec" status: 202 len: 0 microversion: 2.20 time: 120.395640 Dec 15 14:18:15.952114 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 651/1399] 10.222.0.42 () {60 vars in 1456 bytes} [Wed Dec 15 14:16:15 2021] DELETE /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/os-volume_attachments/7267792b-a221-4709-9588-a9838e8b0eec => generated 0 bytes in 120397 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:18:16.010433 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-8a59e402-5a1c-44a3-8b30-4cee392860a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] HTTP exception thrown: Instance fcc65306-f419-4eac-97a2-407c5d6744da is not attached to volume 7267792b-a221-4709-9588-a9838e8b0eec Dec 15 14:18:16.011160 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8a59e402-5a1c-44a3-8b30-4cee392860a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Returning 404 to user: Instance fcc65306-f419-4eac-97a2-407c5d6744da is not attached to volume 7267792b-a221-4709-9588-a9838e8b0eec {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:18:16.012225 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8a59e402-5a1c-44a3-8b30-4cee392860a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/os-volume_attachments/7267792b-a221-4709-9588-a9838e8b0eec" status: 404 len: 154 microversion: 2.20 time: 60.393658 Dec 15 14:18:16.012804 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 749/1400] 10.222.0.42 () {60 vars in 1456 bytes} [Wed Dec 15 14:17:15 2021] DELETE /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/os-volume_attachments/7267792b-a221-4709-9588-a9838e8b0eec => generated 154 bytes in 60396 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 14:18:16.018260 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a2879bcf-c972-4ce1-aa12-b12eef1195ec tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:16.019137 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a2879bcf-c972-4ce1-aa12-b12eef1195ec tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:16.027467 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2879bcf-c972-4ce1-aa12-b12eef1195ec tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:16.027918 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2879bcf-c972-4ce1-aa12-b12eef1195ec tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:16.028945 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2879bcf-c972-4ce1-aa12-b12eef1195ec tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:16.029383 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2879bcf-c972-4ce1-aa12-b12eef1195ec tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:16.125793 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a2879bcf-c972-4ce1-aa12-b12eef1195ec tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action" status: 200 len: 38315 microversion: 2.1 time: 0.111534 Dec 15 14:18:16.126921 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 750/1401] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Dec 15 14:18:16 2021] POST /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/action => generated 38315 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:18:16.135049 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c7085f6d-4f5a-433b-b0b8-c04848f93bc5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:16.135663 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c7085f6d-4f5a-433b-b0b8-c04848f93bc5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:16.137443 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-21018563-18ca-4406-8073-cdb319f9beb5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:16.138076 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-21018563-18ca-4406-8073-cdb319f9beb5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:16.142948 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7085f6d-4f5a-433b-b0b8-c04848f93bc5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:16.143319 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7085f6d-4f5a-433b-b0b8-c04848f93bc5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:16.144110 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7085f6d-4f5a-433b-b0b8-c04848f93bc5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:16.144545 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7085f6d-4f5a-433b-b0b8-c04848f93bc5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:16.146572 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21018563-18ca-4406-8073-cdb319f9beb5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:16.147270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21018563-18ca-4406-8073-cdb319f9beb5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:16.148084 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21018563-18ca-4406-8073-cdb319f9beb5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:16.148521 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21018563-18ca-4406-8073-cdb319f9beb5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:16.294805 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c7085f6d-4f5a-433b-b0b8-c04848f93bc5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:16.302484 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c7085f6d-4f5a-433b-b0b8-c04848f93bc5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.349368 Dec 15 14:18:16.303221 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 652/1402] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:15 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:16.307398 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cb02650c-3ef7-4810-a636-7d7c836dcf65 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:16.307890 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cb02650c-3ef7-4810-a636-7d7c836dcf65 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:16.313865 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb02650c-3ef7-4810-a636-7d7c836dcf65 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:16.314315 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb02650c-3ef7-4810-a636-7d7c836dcf65 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:16.315106 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb02650c-3ef7-4810-a636-7d7c836dcf65 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:16.315539 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb02650c-3ef7-4810-a636-7d7c836dcf65 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:16.339683 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cb02650c-3ef7-4810-a636-7d7c836dcf65 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/ips" status: 200 len: 145 microversion: 2.1 time: 0.035420 Dec 15 14:18:16.340359 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 653/1403] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Dec 15 14:18:16 2021] GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:18:17.471520 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-accb54f2-0055-4e7d-8b70-b129772bad04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:17.472121 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-accb54f2-0055-4e7d-8b70-b129772bad04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:17.479156 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-accb54f2-0055-4e7d-8b70-b129772bad04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:17.479686 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-accb54f2-0055-4e7d-8b70-b129772bad04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:17.480688 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-accb54f2-0055-4e7d-8b70-b129772bad04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:17.481169 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-accb54f2-0055-4e7d-8b70-b129772bad04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:17.508336 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-accb54f2-0055-4e7d-8b70-b129772bad04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:18:17.609222 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-accb54f2-0055-4e7d-8b70-b129772bad04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "DELETE /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 204 len: 0 microversion: 2.1 time: 0.140853 Dec 15 14:18:17.610197 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 654/1404] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:18:17 2021] DELETE /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:18:17.676280 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-890aa42f-2509-491d-8525-6abc1adcb5e3 req-094e1fcb-c3b6-4963-8eac-3585184841d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12be41af-387a-4090-93dd-d26d8e97bf45", "tag": "ffe19195-444e-423e-ac6a-9120626e5ae8"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:17.677833 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:18:17.677833 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:18:17.685114 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-890aa42f-2509-491d-8525-6abc1adcb5e3 req-094e1fcb-c3b6-4963-8eac-3585184841d0 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:17.685561 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-890aa42f-2509-491d-8525-6abc1adcb5e3 req-094e1fcb-c3b6-4963-8eac-3585184841d0 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:17.697056 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-890aa42f-2509-491d-8525-6abc1adcb5e3 req-094e1fcb-c3b6-4963-8eac-3585184841d0 service nova] Creating event network-changed:ffe19195-444e-423e-ac6a-9120626e5ae8 for instance 12be41af-387a-4090-93dd-d26d8e97bf45 on hv-cinder-82182 Dec 15 14:18:17.701939 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-890aa42f-2509-491d-8525-6abc1adcb5e3 req-094e1fcb-c3b6-4963-8eac-3585184841d0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090012 Dec 15 14:18:17.702515 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 655/1405] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:18:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:18:17.707179 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6bbc48ad-63f7-4323-88a8-b91af81612b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:17.708192 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6bbc48ad-63f7-4323-88a8-b91af81612b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:17.715088 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bbc48ad-63f7-4323-88a8-b91af81612b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:17.715560 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bbc48ad-63f7-4323-88a8-b91af81612b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:17.716337 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bbc48ad-63f7-4323-88a8-b91af81612b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:17.716764 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bbc48ad-63f7-4323-88a8-b91af81612b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:17.945908 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6bbc48ad-63f7-4323-88a8-b91af81612b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:17.954068 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6bbc48ad-63f7-4323-88a8-b91af81612b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1568 microversion: 2.1 time: 0.250244 Dec 15 14:18:17.965120 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 656/1406] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:17 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1568 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:18.979214 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c5505d4c-a019-449a-94c0-3be21070b53b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:18.979899 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c5505d4c-a019-449a-94c0-3be21070b53b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:18.986906 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c5505d4c-a019-449a-94c0-3be21070b53b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:18.987350 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c5505d4c-a019-449a-94c0-3be21070b53b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:18.988134 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c5505d4c-a019-449a-94c0-3be21070b53b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:18.988570 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c5505d4c-a019-449a-94c0-3be21070b53b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:19.268574 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c5505d4c-a019-449a-94c0-3be21070b53b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:19.277200 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c5505d4c-a019-449a-94c0-3be21070b53b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.306262 Dec 15 14:18:19.277811 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 657/1407] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:18 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:20.298608 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-38a45b27-b120-4d81-b421-9c5356440722 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:20.299966 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-38a45b27-b120-4d81-b421-9c5356440722 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:20.310660 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38a45b27-b120-4d81-b421-9c5356440722 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:20.311420 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38a45b27-b120-4d81-b421-9c5356440722 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:20.312717 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38a45b27-b120-4d81-b421-9c5356440722 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:20.313447 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38a45b27-b120-4d81-b421-9c5356440722 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:20.457012 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-38a45b27-b120-4d81-b421-9c5356440722 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:20.465905 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-38a45b27-b120-4d81-b421-9c5356440722 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.173405 Dec 15 14:18:20.466465 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 658/1408] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:20 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:21.486571 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c89da717-940b-48a7-88c9-be7782e16b24 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:21.487709 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c89da717-940b-48a7-88c9-be7782e16b24 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:21.496495 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c89da717-940b-48a7-88c9-be7782e16b24 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:21.496938 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c89da717-940b-48a7-88c9-be7782e16b24 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:21.497742 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c89da717-940b-48a7-88c9-be7782e16b24 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:21.498181 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c89da717-940b-48a7-88c9-be7782e16b24 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:21.660828 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c89da717-940b-48a7-88c9-be7782e16b24 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:21.669808 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c89da717-940b-48a7-88c9-be7782e16b24 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.189462 Dec 15 14:18:21.670375 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 659/1409] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:21 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:22.698601 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-46eb0ac4-95c1-46f9-9b2b-7a7db4144ba1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:22.699564 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-46eb0ac4-95c1-46f9-9b2b-7a7db4144ba1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:22.707119 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-46eb0ac4-95c1-46f9-9b2b-7a7db4144ba1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:22.707631 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-46eb0ac4-95c1-46f9-9b2b-7a7db4144ba1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:22.708869 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-46eb0ac4-95c1-46f9-9b2b-7a7db4144ba1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:22.709347 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-46eb0ac4-95c1-46f9-9b2b-7a7db4144ba1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:22.866543 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-46eb0ac4-95c1-46f9-9b2b-7a7db4144ba1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:22.874218 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-46eb0ac4-95c1-46f9-9b2b-7a7db4144ba1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.182168 Dec 15 14:18:22.874785 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 660/1410] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:22 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:23.901156 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-da03e874-396c-49c8-87cd-70448a38504a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:23.902264 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-da03e874-396c-49c8-87cd-70448a38504a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:23.913659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da03e874-396c-49c8-87cd-70448a38504a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:23.914436 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da03e874-396c-49c8-87cd-70448a38504a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:23.915825 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da03e874-396c-49c8-87cd-70448a38504a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:23.916276 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da03e874-396c-49c8-87cd-70448a38504a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:24.074924 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-da03e874-396c-49c8-87cd-70448a38504a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:24.086902 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-da03e874-396c-49c8-87cd-70448a38504a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.192010 Dec 15 14:18:24.088314 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 661/1411] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:23 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:25.112707 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2dbc9b8a-2658-4094-96fd-aafe1cccba5f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:25.113526 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2dbc9b8a-2658-4094-96fd-aafe1cccba5f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:25.121202 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2dbc9b8a-2658-4094-96fd-aafe1cccba5f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:25.121671 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2dbc9b8a-2658-4094-96fd-aafe1cccba5f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:25.122445 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2dbc9b8a-2658-4094-96fd-aafe1cccba5f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:25.122875 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2dbc9b8a-2658-4094-96fd-aafe1cccba5f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:25.279630 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2dbc9b8a-2658-4094-96fd-aafe1cccba5f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:25.287701 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2dbc9b8a-2658-4094-96fd-aafe1cccba5f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.180174 Dec 15 14:18:25.288265 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 662/1412] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:25 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:26.229271 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-21018563-18ca-4406-8073-cdb319f9beb5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] HTTP exception thrown: Instance fcc65306-f419-4eac-97a2-407c5d6744da is not attached to volume 7267792b-a221-4709-9588-a9838e8b0eec Dec 15 14:18:26.229886 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-21018563-18ca-4406-8073-cdb319f9beb5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Returning 404 to user: Instance fcc65306-f419-4eac-97a2-407c5d6744da is not attached to volume 7267792b-a221-4709-9588-a9838e8b0eec {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:18:26.230758 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-21018563-18ca-4406-8073-cdb319f9beb5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/os-volume_attachments/7267792b-a221-4709-9588-a9838e8b0eec" status: 404 len: 154 microversion: 2.20 time: 10.102587 Dec 15 14:18:26.231508 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 751/1413] 10.222.0.42 () {60 vars in 1456 bytes} [Wed Dec 15 14:18:16 2021] DELETE /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/os-volume_attachments/7267792b-a221-4709-9588-a9838e8b0eec => generated 154 bytes in 10104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 14:18:26.240020 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-66fb3f4c-2f08-4be9-aa48-949463c52cc3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:26.241053 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-66fb3f4c-2f08-4be9-aa48-949463c52cc3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:26.248261 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66fb3f4c-2f08-4be9-aa48-949463c52cc3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:26.248849 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66fb3f4c-2f08-4be9-aa48-949463c52cc3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:26.249463 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66fb3f4c-2f08-4be9-aa48-949463c52cc3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:26.249927 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66fb3f4c-2f08-4be9-aa48-949463c52cc3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:26.283653 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-66fb3f4c-2f08-4be9-aa48-949463c52cc3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047467 Dec 15 14:18:26.284590 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 663/1414] 10.222.0.42 () {60 vars in 1342 bytes} [Wed Dec 15 14:18:26 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:18:26.304342 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d7d1b35c-160a-4e32-912f-e294ea52a215 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:26.305115 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d7d1b35c-160a-4e32-912f-e294ea52a215 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:26.311980 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d7d1b35c-160a-4e32-912f-e294ea52a215 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:26.312519 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d7d1b35c-160a-4e32-912f-e294ea52a215 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:26.313350 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d7d1b35c-160a-4e32-912f-e294ea52a215 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:26.313819 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d7d1b35c-160a-4e32-912f-e294ea52a215 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:26.457514 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d7d1b35c-160a-4e32-912f-e294ea52a215 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:26.468316 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d7d1b35c-160a-4e32-912f-e294ea52a215 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.167722 Dec 15 14:18:26.477685 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 752/1415] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:26 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:27.489520 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6595232a-0a53-46b0-9f5c-2dfbc9b97731 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:27.490550 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6595232a-0a53-46b0-9f5c-2dfbc9b97731 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:27.499531 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6595232a-0a53-46b0-9f5c-2dfbc9b97731 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:27.500021 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6595232a-0a53-46b0-9f5c-2dfbc9b97731 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:27.500797 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6595232a-0a53-46b0-9f5c-2dfbc9b97731 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:27.501226 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6595232a-0a53-46b0-9f5c-2dfbc9b97731 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:27.661670 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6595232a-0a53-46b0-9f5c-2dfbc9b97731 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:27.671590 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6595232a-0a53-46b0-9f5c-2dfbc9b97731 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.188244 Dec 15 14:18:27.672040 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 664/1416] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:27 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:28.692910 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a4306037-72be-4f00-b675-8f36fa8f97f5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:28.693989 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a4306037-72be-4f00-b675-8f36fa8f97f5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:28.705242 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a4306037-72be-4f00-b675-8f36fa8f97f5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:28.706045 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a4306037-72be-4f00-b675-8f36fa8f97f5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:28.707329 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a4306037-72be-4f00-b675-8f36fa8f97f5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:28.708399 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a4306037-72be-4f00-b675-8f36fa8f97f5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:28.855130 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a4306037-72be-4f00-b675-8f36fa8f97f5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:28.862690 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a4306037-72be-4f00-b675-8f36fa8f97f5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.176020 Dec 15 14:18:28.863269 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 753/1417] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:28 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:29.039226 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:18:29.039487 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:18:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:18:29.884625 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5dae113a-1048-4201-b07c-dba8669f9b46 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:29.889642 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5dae113a-1048-4201-b07c-dba8669f9b46 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:29.896323 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5dae113a-1048-4201-b07c-dba8669f9b46 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:29.897054 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5dae113a-1048-4201-b07c-dba8669f9b46 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:29.898378 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5dae113a-1048-4201-b07c-dba8669f9b46 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:29.899099 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5dae113a-1048-4201-b07c-dba8669f9b46 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:30.064481 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5dae113a-1048-4201-b07c-dba8669f9b46 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:30.072350 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5dae113a-1048-4201-b07c-dba8669f9b46 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.194045 Dec 15 14:18:30.072926 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 665/1418] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:29 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:31.091555 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ff4d3b89-2252-4609-9e9c-9e49b9a01aa0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:31.092132 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ff4d3b89-2252-4609-9e9c-9e49b9a01aa0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:31.098978 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ff4d3b89-2252-4609-9e9c-9e49b9a01aa0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:31.099461 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ff4d3b89-2252-4609-9e9c-9e49b9a01aa0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:31.100197 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ff4d3b89-2252-4609-9e9c-9e49b9a01aa0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:31.100681 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ff4d3b89-2252-4609-9e9c-9e49b9a01aa0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:31.243852 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ff4d3b89-2252-4609-9e9c-9e49b9a01aa0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:31.251737 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ff4d3b89-2252-4609-9e9c-9e49b9a01aa0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.164628 Dec 15 14:18:31.252339 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 754/1419] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:31 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:32.273067 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ff4fa9f0-1c98-4fc5-a78f-da7493a35d55 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:32.274092 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ff4fa9f0-1c98-4fc5-a78f-da7493a35d55 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:32.283535 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ff4fa9f0-1c98-4fc5-a78f-da7493a35d55 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:32.283975 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ff4fa9f0-1c98-4fc5-a78f-da7493a35d55 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:32.284837 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ff4fa9f0-1c98-4fc5-a78f-da7493a35d55 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:32.285220 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ff4fa9f0-1c98-4fc5-a78f-da7493a35d55 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:32.441927 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ff4fa9f0-1c98-4fc5-a78f-da7493a35d55 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:32.453764 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ff4fa9f0-1c98-4fc5-a78f-da7493a35d55 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.186574 Dec 15 14:18:32.454338 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 666/1420] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:32 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:33.475894 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-16be25a4-6dee-4cb2-92bc-21a897fb8bda tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:33.476876 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-16be25a4-6dee-4cb2-92bc-21a897fb8bda tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:33.487403 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16be25a4-6dee-4cb2-92bc-21a897fb8bda tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:33.487853 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16be25a4-6dee-4cb2-92bc-21a897fb8bda tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:33.488656 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16be25a4-6dee-4cb2-92bc-21a897fb8bda tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:33.489093 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16be25a4-6dee-4cb2-92bc-21a897fb8bda tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:33.633234 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-16be25a4-6dee-4cb2-92bc-21a897fb8bda tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:33.647072 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-16be25a4-6dee-4cb2-92bc-21a897fb8bda tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.177583 Dec 15 14:18:33.647849 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 755/1421] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:33 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:34.671527 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5480fd56-dfb9-4bf4-bcf9-2f4830c5b58c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:34.672502 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5480fd56-dfb9-4bf4-bcf9-2f4830c5b58c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:34.680124 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5480fd56-dfb9-4bf4-bcf9-2f4830c5b58c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:34.680584 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5480fd56-dfb9-4bf4-bcf9-2f4830c5b58c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:34.681383 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5480fd56-dfb9-4bf4-bcf9-2f4830c5b58c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:34.681859 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5480fd56-dfb9-4bf4-bcf9-2f4830c5b58c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:34.833151 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5480fd56-dfb9-4bf4-bcf9-2f4830c5b58c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:34.850851 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5480fd56-dfb9-4bf4-bcf9-2f4830c5b58c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.185397 Dec 15 14:18:34.851427 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 667/1422] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:34 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:35.872406 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5fe0d3da-667d-49e3-8b0c-3ff1a1b04a17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:35.873450 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5fe0d3da-667d-49e3-8b0c-3ff1a1b04a17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:35.882399 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5fe0d3da-667d-49e3-8b0c-3ff1a1b04a17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:35.882853 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5fe0d3da-667d-49e3-8b0c-3ff1a1b04a17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:35.883649 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5fe0d3da-667d-49e3-8b0c-3ff1a1b04a17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:35.884086 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5fe0d3da-667d-49e3-8b0c-3ff1a1b04a17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:36.033927 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5fe0d3da-667d-49e3-8b0c-3ff1a1b04a17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:36.042007 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5fe0d3da-667d-49e3-8b0c-3ff1a1b04a17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.175886 Dec 15 14:18:36.042607 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 756/1423] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:35 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:37.063070 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ea53417b-f894-4b70-92d3-a4e7ff9e35ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:37.063982 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ea53417b-f894-4b70-92d3-a4e7ff9e35ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:37.075689 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ea53417b-f894-4b70-92d3-a4e7ff9e35ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:37.076428 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ea53417b-f894-4b70-92d3-a4e7ff9e35ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:37.077757 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ea53417b-f894-4b70-92d3-a4e7ff9e35ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:37.078480 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ea53417b-f894-4b70-92d3-a4e7ff9e35ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:37.224047 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ea53417b-f894-4b70-92d3-a4e7ff9e35ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:37.231481 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ea53417b-f894-4b70-92d3-a4e7ff9e35ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.174842 Dec 15 14:18:37.232044 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 668/1424] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:37 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:38.252551 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b5bac802-bf4a-42f4-a276-1b443045d12a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:38.253498 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b5bac802-bf4a-42f4-a276-1b443045d12a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:38.260487 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5bac802-bf4a-42f4-a276-1b443045d12a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:38.260942 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5bac802-bf4a-42f4-a276-1b443045d12a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:38.261771 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5bac802-bf4a-42f4-a276-1b443045d12a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:38.262211 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5bac802-bf4a-42f4-a276-1b443045d12a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:38.412354 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b5bac802-bf4a-42f4-a276-1b443045d12a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:38.420615 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b5bac802-bf4a-42f4-a276-1b443045d12a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.174541 Dec 15 14:18:38.421179 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 757/1425] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:38 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:39.442684 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1ce7c3ad-55a6-4bee-aee6-40ddaba982f8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:39.443277 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1ce7c3ad-55a6-4bee-aee6-40ddaba982f8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:39.450378 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ce7c3ad-55a6-4bee-aee6-40ddaba982f8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:39.450838 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ce7c3ad-55a6-4bee-aee6-40ddaba982f8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:39.451627 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ce7c3ad-55a6-4bee-aee6-40ddaba982f8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:39.452050 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ce7c3ad-55a6-4bee-aee6-40ddaba982f8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:39.602130 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1ce7c3ad-55a6-4bee-aee6-40ddaba982f8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:39.613974 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1ce7c3ad-55a6-4bee-aee6-40ddaba982f8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.176352 Dec 15 14:18:39.614758 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 669/1426] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:39 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:40.639412 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bbad27d8-c194-4248-a036-7abad0b4c12b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:40.640020 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bbad27d8-c194-4248-a036-7abad0b4c12b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:40.648644 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bbad27d8-c194-4248-a036-7abad0b4c12b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:40.649066 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bbad27d8-c194-4248-a036-7abad0b4c12b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:40.649889 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bbad27d8-c194-4248-a036-7abad0b4c12b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:40.650447 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bbad27d8-c194-4248-a036-7abad0b4c12b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:40.803083 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bbad27d8-c194-4248-a036-7abad0b4c12b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:40.814637 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bbad27d8-c194-4248-a036-7abad0b4c12b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.181107 Dec 15 14:18:40.815338 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 758/1427] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:40 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:41.836893 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ec3e92b0-658f-43f6-adb6-009a638d1f53 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:41.837960 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ec3e92b0-658f-43f6-adb6-009a638d1f53 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:41.847643 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec3e92b0-658f-43f6-adb6-009a638d1f53 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:41.848333 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec3e92b0-658f-43f6-adb6-009a638d1f53 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:41.849581 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec3e92b0-658f-43f6-adb6-009a638d1f53 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:41.850031 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec3e92b0-658f-43f6-adb6-009a638d1f53 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:41.987525 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ec3e92b0-658f-43f6-adb6-009a638d1f53 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:41.999891 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ec3e92b0-658f-43f6-adb6-009a638d1f53 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.169304 Dec 15 14:18:42.000694 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 670/1428] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:41 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:43.021415 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-19fe698b-5e29-444c-9b11-cfaca04e3dd9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:43.022071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-19fe698b-5e29-444c-9b11-cfaca04e3dd9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:43.028928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-19fe698b-5e29-444c-9b11-cfaca04e3dd9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:43.029352 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-19fe698b-5e29-444c-9b11-cfaca04e3dd9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:43.030157 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-19fe698b-5e29-444c-9b11-cfaca04e3dd9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:43.030613 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-19fe698b-5e29-444c-9b11-cfaca04e3dd9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:43.173067 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-19fe698b-5e29-444c-9b11-cfaca04e3dd9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:43.181204 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-19fe698b-5e29-444c-9b11-cfaca04e3dd9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.165026 Dec 15 14:18:43.181827 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 759/1429] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:43 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:44.205454 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f632e709-90cb-4326-9292-ae71bb09f9b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:44.206356 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f632e709-90cb-4326-9292-ae71bb09f9b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:44.217114 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f632e709-90cb-4326-9292-ae71bb09f9b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:44.217749 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f632e709-90cb-4326-9292-ae71bb09f9b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:44.218754 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f632e709-90cb-4326-9292-ae71bb09f9b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:44.219315 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f632e709-90cb-4326-9292-ae71bb09f9b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:44.365972 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f632e709-90cb-4326-9292-ae71bb09f9b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:44.374355 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f632e709-90cb-4326-9292-ae71bb09f9b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.174635 Dec 15 14:18:44.374934 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 671/1430] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:44 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:45.395072 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7afa0492-a088-4939-9341-9e8027f7585f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:45.396252 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7afa0492-a088-4939-9341-9e8027f7585f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:45.405940 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7afa0492-a088-4939-9341-9e8027f7585f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:45.406424 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7afa0492-a088-4939-9341-9e8027f7585f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:45.407213 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7afa0492-a088-4939-9341-9e8027f7585f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:45.407649 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7afa0492-a088-4939-9341-9e8027f7585f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:45.553205 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7afa0492-a088-4939-9341-9e8027f7585f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:45.564492 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7afa0492-a088-4939-9341-9e8027f7585f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.175579 Dec 15 14:18:45.565269 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 760/1431] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:45 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:46.583424 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e2a0ff33-119a-47db-91f0-c5109ec65a19 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:46.584255 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e2a0ff33-119a-47db-91f0-c5109ec65a19 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:46.591251 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2a0ff33-119a-47db-91f0-c5109ec65a19 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:46.591695 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2a0ff33-119a-47db-91f0-c5109ec65a19 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:46.592467 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2a0ff33-119a-47db-91f0-c5109ec65a19 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:46.592894 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2a0ff33-119a-47db-91f0-c5109ec65a19 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:46.731376 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e2a0ff33-119a-47db-91f0-c5109ec65a19 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:46.742986 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e2a0ff33-119a-47db-91f0-c5109ec65a19 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.163609 Dec 15 14:18:46.743561 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 672/1432] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:46 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:47.760695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-53d0b832-da2d-4028-ab87-5db9913d1745 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:47.761380 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-53d0b832-da2d-4028-ab87-5db9913d1745 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:47.768766 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53d0b832-da2d-4028-ab87-5db9913d1745 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:47.769224 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53d0b832-da2d-4028-ab87-5db9913d1745 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:47.770087 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53d0b832-da2d-4028-ab87-5db9913d1745 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:47.770677 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53d0b832-da2d-4028-ab87-5db9913d1745 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:47.907270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-53d0b832-da2d-4028-ab87-5db9913d1745 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:47.915962 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-53d0b832-da2d-4028-ab87-5db9913d1745 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.159174 Dec 15 14:18:47.916545 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 761/1433] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:47 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:48.938326 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1a0613dc-6938-47bb-b6dd-a92198de3211 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:48.939249 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1a0613dc-6938-47bb-b6dd-a92198de3211 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:48.955507 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a0613dc-6938-47bb-b6dd-a92198de3211 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:48.958409 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a0613dc-6938-47bb-b6dd-a92198de3211 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:48.959714 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a0613dc-6938-47bb-b6dd-a92198de3211 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:48.960446 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a0613dc-6938-47bb-b6dd-a92198de3211 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:49.108478 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1a0613dc-6938-47bb-b6dd-a92198de3211 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:49.116495 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1a0613dc-6938-47bb-b6dd-a92198de3211 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.184483 Dec 15 14:18:49.117054 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 673/1434] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:48 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:50.137008 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6696c91d-d754-49b8-9285-bc0c68f58a04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:50.137737 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6696c91d-d754-49b8-9285-bc0c68f58a04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:50.145531 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6696c91d-d754-49b8-9285-bc0c68f58a04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:50.146105 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6696c91d-d754-49b8-9285-bc0c68f58a04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:50.147032 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6696c91d-d754-49b8-9285-bc0c68f58a04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:50.147543 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6696c91d-d754-49b8-9285-bc0c68f58a04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:50.293224 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6696c91d-d754-49b8-9285-bc0c68f58a04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:50.301356 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6696c91d-d754-49b8-9285-bc0c68f58a04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.169479 Dec 15 14:18:50.301988 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 762/1435] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:50 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:51.322462 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-64c672c1-ecd4-4003-b391-1b2beb3c77bc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:51.323127 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-64c672c1-ecd4-4003-b391-1b2beb3c77bc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:51.330017 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-64c672c1-ecd4-4003-b391-1b2beb3c77bc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:51.330496 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-64c672c1-ecd4-4003-b391-1b2beb3c77bc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:51.331298 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-64c672c1-ecd4-4003-b391-1b2beb3c77bc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:51.331733 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-64c672c1-ecd4-4003-b391-1b2beb3c77bc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:51.479038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-64c672c1-ecd4-4003-b391-1b2beb3c77bc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:51.487450 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-64c672c1-ecd4-4003-b391-1b2beb3c77bc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.171216 Dec 15 14:18:51.488042 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 674/1436] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:51 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:52.504956 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5f554eda-8492-4513-a8a7-89eb0f0dffd6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:52.505554 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5f554eda-8492-4513-a8a7-89eb0f0dffd6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:52.512400 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f554eda-8492-4513-a8a7-89eb0f0dffd6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:52.512842 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f554eda-8492-4513-a8a7-89eb0f0dffd6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:52.513623 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f554eda-8492-4513-a8a7-89eb0f0dffd6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:52.514089 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f554eda-8492-4513-a8a7-89eb0f0dffd6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:52.654701 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5f554eda-8492-4513-a8a7-89eb0f0dffd6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:52.663012 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5f554eda-8492-4513-a8a7-89eb0f0dffd6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.161782 Dec 15 14:18:52.663585 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 763/1437] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:52 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:53.684605 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b7ef43ec-81d6-49a1-8e99-29cb74969e1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:53.685698 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b7ef43ec-81d6-49a1-8e99-29cb74969e1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:53.696749 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7ef43ec-81d6-49a1-8e99-29cb74969e1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:53.697504 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7ef43ec-81d6-49a1-8e99-29cb74969e1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:53.699108 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7ef43ec-81d6-49a1-8e99-29cb74969e1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:53.699987 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7ef43ec-81d6-49a1-8e99-29cb74969e1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:53.854674 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b7ef43ec-81d6-49a1-8e99-29cb74969e1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:53.862576 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b7ef43ec-81d6-49a1-8e99-29cb74969e1e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.184595 Dec 15 14:18:53.863144 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 675/1438] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:53 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:54.883473 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-65027ace-a8f4-4f83-9731-3a01a57001be tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:54.884349 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-65027ace-a8f4-4f83-9731-3a01a57001be tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:54.894109 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-65027ace-a8f4-4f83-9731-3a01a57001be tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:54.894754 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-65027ace-a8f4-4f83-9731-3a01a57001be tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:54.895870 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-65027ace-a8f4-4f83-9731-3a01a57001be tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:54.896496 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-65027ace-a8f4-4f83-9731-3a01a57001be tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:55.045964 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-65027ace-a8f4-4f83-9731-3a01a57001be tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:55.054404 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-65027ace-a8f4-4f83-9731-3a01a57001be tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.176257 Dec 15 14:18:55.054984 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 764/1439] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:54 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:56.076063 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0fec6d86-74f9-4b0d-9437-22abb455ea8f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:56.076689 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0fec6d86-74f9-4b0d-9437-22abb455ea8f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:56.083782 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fec6d86-74f9-4b0d-9437-22abb455ea8f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:56.084233 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fec6d86-74f9-4b0d-9437-22abb455ea8f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:56.085023 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fec6d86-74f9-4b0d-9437-22abb455ea8f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:56.085461 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fec6d86-74f9-4b0d-9437-22abb455ea8f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:56.233328 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0fec6d86-74f9-4b0d-9437-22abb455ea8f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:56.245921 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0fec6d86-74f9-4b0d-9437-22abb455ea8f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.176081 Dec 15 14:18:56.246836 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 676/1440] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:56 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:57.266320 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ab5206b0-8893-48e9-8de9-302ff757869e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:57.266996 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ab5206b0-8893-48e9-8de9-302ff757869e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:57.273671 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ab5206b0-8893-48e9-8de9-302ff757869e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:57.274130 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ab5206b0-8893-48e9-8de9-302ff757869e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:57.274913 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ab5206b0-8893-48e9-8de9-302ff757869e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:57.275350 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ab5206b0-8893-48e9-8de9-302ff757869e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:57.413357 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ab5206b0-8893-48e9-8de9-302ff757869e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:57.420906 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ab5206b0-8893-48e9-8de9-302ff757869e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.159754 Dec 15 14:18:57.421473 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 765/1441] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:57 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:58.442100 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d7723fc6-2a7e-422d-b16f-1aea75490b2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:58.443053 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d7723fc6-2a7e-422d-b16f-1aea75490b2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:58.454094 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7723fc6-2a7e-422d-b16f-1aea75490b2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:58.454822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7723fc6-2a7e-422d-b16f-1aea75490b2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:58.456082 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7723fc6-2a7e-422d-b16f-1aea75490b2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:58.457180 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7723fc6-2a7e-422d-b16f-1aea75490b2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:58.623279 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d7723fc6-2a7e-422d-b16f-1aea75490b2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:58.631428 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d7723fc6-2a7e-422d-b16f-1aea75490b2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.195607 Dec 15 14:18:58.632002 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 677/1442] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:58 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:59.652582 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-456c1bb0-8317-43bf-b8cc-14e9fa6d0a3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:59.653685 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-456c1bb0-8317-43bf-b8cc-14e9fa6d0a3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:59.664951 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-456c1bb0-8317-43bf-b8cc-14e9fa6d0a3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:59.665709 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-456c1bb0-8317-43bf-b8cc-14e9fa6d0a3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:59.667046 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-456c1bb0-8317-43bf-b8cc-14e9fa6d0a3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:59.667755 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-456c1bb0-8317-43bf-b8cc-14e9fa6d0a3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:59.825785 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-456c1bb0-8317-43bf-b8cc-14e9fa6d0a3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:59.834551 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-456c1bb0-8317-43bf-b8cc-14e9fa6d0a3a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.188182 Dec 15 14:18:59.835126 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 766/1443] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:59 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:00.853257 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b16d9122-181a-4459-9544-dd1d78656616 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:00.854027 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b16d9122-181a-4459-9544-dd1d78656616 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:00.862778 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b16d9122-181a-4459-9544-dd1d78656616 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:00.863341 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b16d9122-181a-4459-9544-dd1d78656616 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:00.864317 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b16d9122-181a-4459-9544-dd1d78656616 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:00.864863 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b16d9122-181a-4459-9544-dd1d78656616 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:01.013661 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b16d9122-181a-4459-9544-dd1d78656616 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:01.022009 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b16d9122-181a-4459-9544-dd1d78656616 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.173416 Dec 15 14:19:01.022582 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 678/1444] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:00 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:02.043763 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-eaff36a5-192b-46b4-bf68-601c87323818 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:02.044667 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-eaff36a5-192b-46b4-bf68-601c87323818 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:02.052462 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eaff36a5-192b-46b4-bf68-601c87323818 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:02.052918 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eaff36a5-192b-46b4-bf68-601c87323818 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:02.053759 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eaff36a5-192b-46b4-bf68-601c87323818 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:02.054200 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eaff36a5-192b-46b4-bf68-601c87323818 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:02.200372 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-eaff36a5-192b-46b4-bf68-601c87323818 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:02.213358 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-eaff36a5-192b-46b4-bf68-601c87323818 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.175722 Dec 15 14:19:02.214219 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 767/1445] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:02 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:03.235691 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-70f3fe63-9b8b-4a5c-87c9-c34ba8df93ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:03.236411 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-70f3fe63-9b8b-4a5c-87c9-c34ba8df93ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:03.244472 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70f3fe63-9b8b-4a5c-87c9-c34ba8df93ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:03.244999 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70f3fe63-9b8b-4a5c-87c9-c34ba8df93ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:03.245963 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70f3fe63-9b8b-4a5c-87c9-c34ba8df93ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:03.246480 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70f3fe63-9b8b-4a5c-87c9-c34ba8df93ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:03.402791 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-70f3fe63-9b8b-4a5c-87c9-c34ba8df93ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:03.411450 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-70f3fe63-9b8b-4a5c-87c9-c34ba8df93ac tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.181413 Dec 15 14:19:03.412071 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 679/1446] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:03 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:04.433119 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-eaf6553a-34a8-4f6c-a312-862b099552a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:04.433995 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-eaf6553a-34a8-4f6c-a312-862b099552a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:04.441456 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eaf6553a-34a8-4f6c-a312-862b099552a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:04.441968 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eaf6553a-34a8-4f6c-a312-862b099552a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:04.442727 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eaf6553a-34a8-4f6c-a312-862b099552a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:04.443158 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eaf6553a-34a8-4f6c-a312-862b099552a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:04.590209 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-eaf6553a-34a8-4f6c-a312-862b099552a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:04.598226 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-eaf6553a-34a8-4f6c-a312-862b099552a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.170219 Dec 15 14:19:04.598803 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 768/1447] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:04 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:05.615673 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9fac8ba1-195f-4443-84a9-eda8f546ca84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:05.616317 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9fac8ba1-195f-4443-84a9-eda8f546ca84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:05.622601 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fac8ba1-195f-4443-84a9-eda8f546ca84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:05.623052 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fac8ba1-195f-4443-84a9-eda8f546ca84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:05.623834 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fac8ba1-195f-4443-84a9-eda8f546ca84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:05.624269 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fac8ba1-195f-4443-84a9-eda8f546ca84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:05.769881 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9fac8ba1-195f-4443-84a9-eda8f546ca84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:05.777919 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9fac8ba1-195f-4443-84a9-eda8f546ca84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.166075 Dec 15 14:19:05.778497 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 680/1448] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:05 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:06.799438 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2d851fb5-adb5-4f6d-999c-f527f6f21ce2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:06.800433 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2d851fb5-adb5-4f6d-999c-f527f6f21ce2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:06.809403 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d851fb5-adb5-4f6d-999c-f527f6f21ce2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:06.809903 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d851fb5-adb5-4f6d-999c-f527f6f21ce2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:06.810703 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d851fb5-adb5-4f6d-999c-f527f6f21ce2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:06.811829 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d851fb5-adb5-4f6d-999c-f527f6f21ce2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:07.204150 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2d851fb5-adb5-4f6d-999c-f527f6f21ce2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:07.216096 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2d851fb5-adb5-4f6d-999c-f527f6f21ce2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.422714 Dec 15 14:19:07.217053 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 769/1449] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:06 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:08.240639 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6263f463-8f7b-4278-833f-fe2d8f062362 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:08.241275 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6263f463-8f7b-4278-833f-fe2d8f062362 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:08.249266 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6263f463-8f7b-4278-833f-fe2d8f062362 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:08.249809 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6263f463-8f7b-4278-833f-fe2d8f062362 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:08.250597 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6263f463-8f7b-4278-833f-fe2d8f062362 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:08.251036 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6263f463-8f7b-4278-833f-fe2d8f062362 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:08.393241 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6263f463-8f7b-4278-833f-fe2d8f062362 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:08.401887 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6263f463-8f7b-4278-833f-fe2d8f062362 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.165745 Dec 15 14:19:08.402476 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 681/1450] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:08 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:09.423063 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-44bb4321-d2ea-49e1-8828-755f79b7bf13 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:09.423881 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-44bb4321-d2ea-49e1-8828-755f79b7bf13 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:09.430744 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44bb4321-d2ea-49e1-8828-755f79b7bf13 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:09.431197 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44bb4321-d2ea-49e1-8828-755f79b7bf13 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:09.431983 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44bb4321-d2ea-49e1-8828-755f79b7bf13 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:09.432426 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44bb4321-d2ea-49e1-8828-755f79b7bf13 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:09.582888 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-44bb4321-d2ea-49e1-8828-755f79b7bf13 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:09.590491 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-44bb4321-d2ea-49e1-8828-755f79b7bf13 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.172694 Dec 15 14:19:09.591057 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 770/1451] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:09 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:10.612728 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-00f89d3a-539c-4f79-b106-c8298d634a80 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:10.613770 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-00f89d3a-539c-4f79-b106-c8298d634a80 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:10.624706 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00f89d3a-539c-4f79-b106-c8298d634a80 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:10.625224 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00f89d3a-539c-4f79-b106-c8298d634a80 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:10.626052 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00f89d3a-539c-4f79-b106-c8298d634a80 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:10.626494 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00f89d3a-539c-4f79-b106-c8298d634a80 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:10.771791 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-00f89d3a-539c-4f79-b106-c8298d634a80 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:10.779377 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-00f89d3a-539c-4f79-b106-c8298d634a80 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.173106 Dec 15 14:19:10.779949 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 682/1452] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:10 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:11.797353 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5c38f0ab-1b51-4668-a759-449483eb9586 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:11.798008 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5c38f0ab-1b51-4668-a759-449483eb9586 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:11.808749 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5c38f0ab-1b51-4668-a759-449483eb9586 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:11.809294 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5c38f0ab-1b51-4668-a759-449483eb9586 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:11.810137 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5c38f0ab-1b51-4668-a759-449483eb9586 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:11.810577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5c38f0ab-1b51-4668-a759-449483eb9586 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:11.989067 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5c38f0ab-1b51-4668-a759-449483eb9586 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:12.001025 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5c38f0ab-1b51-4668-a759-449483eb9586 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.207490 Dec 15 14:19:12.001637 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 771/1453] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:11 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:13.023253 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c4bb0a31-dfad-4ed9-ba25-7fa355b1e9e1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:13.024189 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c4bb0a31-dfad-4ed9-ba25-7fa355b1e9e1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:13.035128 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4bb0a31-dfad-4ed9-ba25-7fa355b1e9e1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:13.035766 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4bb0a31-dfad-4ed9-ba25-7fa355b1e9e1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:13.037030 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4bb0a31-dfad-4ed9-ba25-7fa355b1e9e1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:13.037783 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4bb0a31-dfad-4ed9-ba25-7fa355b1e9e1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:13.208914 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c4bb0a31-dfad-4ed9-ba25-7fa355b1e9e1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:13.216384 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c4bb0a31-dfad-4ed9-ba25-7fa355b1e9e1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.199321 Dec 15 14:19:13.216949 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 683/1454] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:13 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:14.234119 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-77bfa382-b8f7-464a-b0f8-c2077f2c4d04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:14.234759 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-77bfa382-b8f7-464a-b0f8-c2077f2c4d04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:14.244085 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-77bfa382-b8f7-464a-b0f8-c2077f2c4d04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:14.244535 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-77bfa382-b8f7-464a-b0f8-c2077f2c4d04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:14.245316 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-77bfa382-b8f7-464a-b0f8-c2077f2c4d04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:14.245796 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-77bfa382-b8f7-464a-b0f8-c2077f2c4d04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:14.403808 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-77bfa382-b8f7-464a-b0f8-c2077f2c4d04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:14.411859 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-77bfa382-b8f7-464a-b0f8-c2077f2c4d04 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.182026 Dec 15 14:19:14.412451 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 772/1455] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:14 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:15.432870 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8b2b6045-e86d-4425-9935-ed5cd82a66b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:15.433927 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8b2b6045-e86d-4425-9935-ed5cd82a66b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:15.444888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8b2b6045-e86d-4425-9935-ed5cd82a66b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:15.445663 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8b2b6045-e86d-4425-9935-ed5cd82a66b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:15.446950 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8b2b6045-e86d-4425-9935-ed5cd82a66b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:15.447660 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8b2b6045-e86d-4425-9935-ed5cd82a66b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:15.594718 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8b2b6045-e86d-4425-9935-ed5cd82a66b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:15.602337 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8b2b6045-e86d-4425-9935-ed5cd82a66b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.175623 Dec 15 14:19:15.602903 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 684/1456] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:15 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:16.621915 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fd939fcf-ee6a-4b1b-b8b9-afee1e666e92 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:16.622648 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fd939fcf-ee6a-4b1b-b8b9-afee1e666e92 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:16.630643 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd939fcf-ee6a-4b1b-b8b9-afee1e666e92 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:16.631105 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd939fcf-ee6a-4b1b-b8b9-afee1e666e92 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:16.632049 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd939fcf-ee6a-4b1b-b8b9-afee1e666e92 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:16.632476 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd939fcf-ee6a-4b1b-b8b9-afee1e666e92 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:16.772293 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fd939fcf-ee6a-4b1b-b8b9-afee1e666e92 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:16.780237 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fd939fcf-ee6a-4b1b-b8b9-afee1e666e92 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.164268 Dec 15 14:19:16.781041 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 773/1457] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:16 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:17.798494 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1ff69659-77d5-4a44-90ff-feaa162565a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:17.799108 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1ff69659-77d5-4a44-90ff-feaa162565a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:17.806010 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ff69659-77d5-4a44-90ff-feaa162565a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:17.806456 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ff69659-77d5-4a44-90ff-feaa162565a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:17.807239 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ff69659-77d5-4a44-90ff-feaa162565a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:17.807675 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ff69659-77d5-4a44-90ff-feaa162565a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:17.945553 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1ff69659-77d5-4a44-90ff-feaa162565a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:17.957971 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1ff69659-77d5-4a44-90ff-feaa162565a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.163435 Dec 15 14:19:17.958747 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 685/1458] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:17 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:18.979861 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-404554b8-912b-48e5-bb75-7ca822fe9f17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:18.980918 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-404554b8-912b-48e5-bb75-7ca822fe9f17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:18.989314 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-404554b8-912b-48e5-bb75-7ca822fe9f17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:18.989808 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-404554b8-912b-48e5-bb75-7ca822fe9f17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:18.990586 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-404554b8-912b-48e5-bb75-7ca822fe9f17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:18.991041 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-404554b8-912b-48e5-bb75-7ca822fe9f17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:19.135524 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-404554b8-912b-48e5-bb75-7ca822fe9f17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:19.143751 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-404554b8-912b-48e5-bb75-7ca822fe9f17 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.170542 Dec 15 14:19:19.144369 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 774/1459] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:18 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:20.164227 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4668c38d-d742-48ad-a5f2-a3c11231a984 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:20.165121 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4668c38d-d742-48ad-a5f2-a3c11231a984 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:20.174116 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4668c38d-d742-48ad-a5f2-a3c11231a984 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:20.174713 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4668c38d-d742-48ad-a5f2-a3c11231a984 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:20.175773 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4668c38d-d742-48ad-a5f2-a3c11231a984 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:20.176396 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4668c38d-d742-48ad-a5f2-a3c11231a984 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:20.329649 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4668c38d-d742-48ad-a5f2-a3c11231a984 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:20.342733 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4668c38d-d742-48ad-a5f2-a3c11231a984 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.183066 Dec 15 14:19:20.343620 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 686/1460] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:20 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:21.370388 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4de67a5d-b7a1-4a99-9ad0-7dfa8d3fcf5c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:21.371039 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4de67a5d-b7a1-4a99-9ad0-7dfa8d3fcf5c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:21.381359 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4de67a5d-b7a1-4a99-9ad0-7dfa8d3fcf5c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:21.382136 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4de67a5d-b7a1-4a99-9ad0-7dfa8d3fcf5c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:21.383426 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4de67a5d-b7a1-4a99-9ad0-7dfa8d3fcf5c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:21.384119 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4de67a5d-b7a1-4a99-9ad0-7dfa8d3fcf5c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:21.536886 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4de67a5d-b7a1-4a99-9ad0-7dfa8d3fcf5c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:21.548744 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4de67a5d-b7a1-4a99-9ad0-7dfa8d3fcf5c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.183947 Dec 15 14:19:21.549507 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 775/1461] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:21 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:22.573475 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f99ec841-85eb-4e88-a01f-b16b34f0a17e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:22.574255 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f99ec841-85eb-4e88-a01f-b16b34f0a17e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:22.583383 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f99ec841-85eb-4e88-a01f-b16b34f0a17e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:22.583947 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f99ec841-85eb-4e88-a01f-b16b34f0a17e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:22.584983 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f99ec841-85eb-4e88-a01f-b16b34f0a17e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:22.585495 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f99ec841-85eb-4e88-a01f-b16b34f0a17e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:22.730712 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f99ec841-85eb-4e88-a01f-b16b34f0a17e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:22.739629 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f99ec841-85eb-4e88-a01f-b16b34f0a17e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.170896 Dec 15 14:19:22.740239 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 687/1462] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:22 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:19:23.759164 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-abd07952-0849-40b0-89cd-275ffa784703 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:23.760088 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-abd07952-0849-40b0-89cd-275ffa784703 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:23.768644 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abd07952-0849-40b0-89cd-275ffa784703 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:23.769168 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abd07952-0849-40b0-89cd-275ffa784703 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:23.770376 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abd07952-0849-40b0-89cd-275ffa784703 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:23.771022 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abd07952-0849-40b0-89cd-275ffa784703 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:23.915295 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-abd07952-0849-40b0-89cd-275ffa784703 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:23.927037 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-abd07952-0849-40b0-89cd-275ffa784703 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.173047 Dec 15 14:19:23.927834 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 776/1463] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:23 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:24.954758 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-54e89676-c8a2-4ce1-8d0b-00db01577096 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:24.955383 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-54e89676-c8a2-4ce1-8d0b-00db01577096 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:24.965070 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54e89676-c8a2-4ce1-8d0b-00db01577096 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:24.965525 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54e89676-c8a2-4ce1-8d0b-00db01577096 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:24.966358 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54e89676-c8a2-4ce1-8d0b-00db01577096 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:24.966785 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54e89676-c8a2-4ce1-8d0b-00db01577096 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:25.105084 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-54e89676-c8a2-4ce1-8d0b-00db01577096 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:25.113675 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-54e89676-c8a2-4ce1-8d0b-00db01577096 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.167745 Dec 15 14:19:25.114258 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 688/1464] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:24 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:26.140102 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-395605e9-edb2-48a0-8761-ce88a1ad4046 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:26.141072 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-395605e9-edb2-48a0-8761-ce88a1ad4046 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:26.149255 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-395605e9-edb2-48a0-8761-ce88a1ad4046 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:26.149735 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-395605e9-edb2-48a0-8761-ce88a1ad4046 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:26.150507 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-395605e9-edb2-48a0-8761-ce88a1ad4046 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:26.150936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-395605e9-edb2-48a0-8761-ce88a1ad4046 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:26.293879 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-395605e9-edb2-48a0-8761-ce88a1ad4046 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:26.303251 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-395605e9-edb2-48a0-8761-ce88a1ad4046 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.169390 Dec 15 14:19:26.303821 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 777/1465] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:26 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:27.325416 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-574542f0-4f25-45aa-8c7f-b19850ea2099 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:27.325416 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-574542f0-4f25-45aa-8c7f-b19850ea2099 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:27.335144 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-574542f0-4f25-45aa-8c7f-b19850ea2099 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:27.335742 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-574542f0-4f25-45aa-8c7f-b19850ea2099 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:27.337883 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-574542f0-4f25-45aa-8c7f-b19850ea2099 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:27.338636 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-574542f0-4f25-45aa-8c7f-b19850ea2099 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:27.488523 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-574542f0-4f25-45aa-8c7f-b19850ea2099 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:27.496699 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-574542f0-4f25-45aa-8c7f-b19850ea2099 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.178073 Dec 15 14:19:27.497276 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 689/1466] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:27 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:28.518913 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-26239a43-ddf3-487d-a693-9643c953548e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:28.519642 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-26239a43-ddf3-487d-a693-9643c953548e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:28.526557 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26239a43-ddf3-487d-a693-9643c953548e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:28.527017 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26239a43-ddf3-487d-a693-9643c953548e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:28.527816 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26239a43-ddf3-487d-a693-9643c953548e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:28.528260 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26239a43-ddf3-487d-a693-9643c953548e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:28.673903 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-26239a43-ddf3-487d-a693-9643c953548e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:28.686612 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-26239a43-ddf3-487d-a693-9643c953548e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.174511 Dec 15 14:19:28.687477 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 778/1467] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:28 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:29.709077 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-24d5836e-ba22-461f-80d1-1560ef50543d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:29.710104 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-24d5836e-ba22-461f-80d1-1560ef50543d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:29.722847 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-24d5836e-ba22-461f-80d1-1560ef50543d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:29.723295 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-24d5836e-ba22-461f-80d1-1560ef50543d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:29.724095 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-24d5836e-ba22-461f-80d1-1560ef50543d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:29.724532 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-24d5836e-ba22-461f-80d1-1560ef50543d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:29.873388 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-24d5836e-ba22-461f-80d1-1560ef50543d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:29.883966 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-24d5836e-ba22-461f-80d1-1560ef50543d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.181634 Dec 15 14:19:29.884681 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 690/1468] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:29 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:30.906151 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-60809edf-bf43-4386-977f-28721e8565aa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:30.907024 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-60809edf-bf43-4386-977f-28721e8565aa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:30.914936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60809edf-bf43-4386-977f-28721e8565aa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:30.915383 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60809edf-bf43-4386-977f-28721e8565aa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:30.916178 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60809edf-bf43-4386-977f-28721e8565aa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:30.916614 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60809edf-bf43-4386-977f-28721e8565aa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:31.066489 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-60809edf-bf43-4386-977f-28721e8565aa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:31.074458 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-60809edf-bf43-4386-977f-28721e8565aa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.174736 Dec 15 14:19:31.075028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 779/1469] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:30 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:32.093762 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dc3349af-fb2b-4473-8eea-2fa43f1b2039 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:32.094369 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dc3349af-fb2b-4473-8eea-2fa43f1b2039 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:32.103313 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc3349af-fb2b-4473-8eea-2fa43f1b2039 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:32.103776 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc3349af-fb2b-4473-8eea-2fa43f1b2039 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:32.104571 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc3349af-fb2b-4473-8eea-2fa43f1b2039 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:32.104998 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc3349af-fb2b-4473-8eea-2fa43f1b2039 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:32.251121 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dc3349af-fb2b-4473-8eea-2fa43f1b2039 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:32.262222 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dc3349af-fb2b-4473-8eea-2fa43f1b2039 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.173273 Dec 15 14:19:32.263031 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 691/1470] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:32 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:33.286668 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-48da7c99-c235-489b-9292-4029fefb08a9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:33.287375 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-48da7c99-c235-489b-9292-4029fefb08a9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:33.295215 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48da7c99-c235-489b-9292-4029fefb08a9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:33.295727 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48da7c99-c235-489b-9292-4029fefb08a9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:33.296641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48da7c99-c235-489b-9292-4029fefb08a9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:33.297141 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48da7c99-c235-489b-9292-4029fefb08a9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:33.454201 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-48da7c99-c235-489b-9292-4029fefb08a9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:33.462809 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-48da7c99-c235-489b-9292-4029fefb08a9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.182466 Dec 15 14:19:33.463372 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 780/1471] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:33 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:34.483846 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d098fae0-da07-4f68-9c74-952c8de2bc67 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:34.484768 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d098fae0-da07-4f68-9c74-952c8de2bc67 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:34.493448 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d098fae0-da07-4f68-9c74-952c8de2bc67 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:34.493992 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d098fae0-da07-4f68-9c74-952c8de2bc67 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:34.494762 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d098fae0-da07-4f68-9c74-952c8de2bc67 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:34.495186 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d098fae0-da07-4f68-9c74-952c8de2bc67 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:34.636757 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d098fae0-da07-4f68-9c74-952c8de2bc67 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:34.648419 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d098fae0-da07-4f68-9c74-952c8de2bc67 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.170721 Dec 15 14:19:34.649164 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 692/1472] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:34 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:35.672997 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e625815f-125b-42f2-973f-6ae0d23fd981 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:35.674131 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e625815f-125b-42f2-973f-6ae0d23fd981 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:35.682428 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e625815f-125b-42f2-973f-6ae0d23fd981 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:35.682874 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e625815f-125b-42f2-973f-6ae0d23fd981 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:35.683657 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e625815f-125b-42f2-973f-6ae0d23fd981 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:35.684094 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e625815f-125b-42f2-973f-6ae0d23fd981 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:35.847855 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e625815f-125b-42f2-973f-6ae0d23fd981 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:35.856772 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e625815f-125b-42f2-973f-6ae0d23fd981 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.189296 Dec 15 14:19:35.857357 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 781/1473] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:35 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:36.876610 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-feac532f-6cee-481b-9a04-c0f9b446fe22 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:36.877427 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-feac532f-6cee-481b-9a04-c0f9b446fe22 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:36.886593 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-feac532f-6cee-481b-9a04-c0f9b446fe22 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:36.887168 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-feac532f-6cee-481b-9a04-c0f9b446fe22 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:36.888345 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-feac532f-6cee-481b-9a04-c0f9b446fe22 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:36.888927 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-feac532f-6cee-481b-9a04-c0f9b446fe22 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:37.038312 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-feac532f-6cee-481b-9a04-c0f9b446fe22 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:37.045860 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-feac532f-6cee-481b-9a04-c0f9b446fe22 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.174599 Dec 15 14:19:37.046436 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 693/1474] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:36 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:38.073401 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-54253e41-aee8-4445-9a8b-2fdb1667c257 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:38.074315 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-54253e41-aee8-4445-9a8b-2fdb1667c257 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:38.085818 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54253e41-aee8-4445-9a8b-2fdb1667c257 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:38.086391 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54253e41-aee8-4445-9a8b-2fdb1667c257 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:38.087180 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54253e41-aee8-4445-9a8b-2fdb1667c257 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:38.087613 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54253e41-aee8-4445-9a8b-2fdb1667c257 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:38.228429 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-54253e41-aee8-4445-9a8b-2fdb1667c257 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:38.235989 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-54253e41-aee8-4445-9a8b-2fdb1667c257 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.169021 Dec 15 14:19:38.236561 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 782/1475] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:38 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:39.254378 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5d120178-8844-4df7-aff7-05fab4db2473 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:39.254990 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5d120178-8844-4df7-aff7-05fab4db2473 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:39.261855 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d120178-8844-4df7-aff7-05fab4db2473 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:39.262303 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d120178-8844-4df7-aff7-05fab4db2473 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:39.263086 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d120178-8844-4df7-aff7-05fab4db2473 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:39.263522 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d120178-8844-4df7-aff7-05fab4db2473 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:39.404244 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5d120178-8844-4df7-aff7-05fab4db2473 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:39.412532 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5d120178-8844-4df7-aff7-05fab4db2473 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.161825 Dec 15 14:19:39.413118 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 694/1476] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:39 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:40.432823 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1b97222a-eeff-44b0-b4f1-7314764e803b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:40.433453 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1b97222a-eeff-44b0-b4f1-7314764e803b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:40.441064 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b97222a-eeff-44b0-b4f1-7314764e803b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:40.441560 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b97222a-eeff-44b0-b4f1-7314764e803b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:40.442456 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b97222a-eeff-44b0-b4f1-7314764e803b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:40.442936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b97222a-eeff-44b0-b4f1-7314764e803b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:40.589200 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1b97222a-eeff-44b0-b4f1-7314764e803b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:40.597357 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1b97222a-eeff-44b0-b4f1-7314764e803b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.170313 Dec 15 14:19:40.598015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 783/1477] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:40 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:41.619103 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6eb404e9-6459-4b82-9247-914e6b835938 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:41.619696 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6eb404e9-6459-4b82-9247-914e6b835938 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:41.626391 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6eb404e9-6459-4b82-9247-914e6b835938 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:41.626833 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6eb404e9-6459-4b82-9247-914e6b835938 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:41.627633 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6eb404e9-6459-4b82-9247-914e6b835938 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:41.628062 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6eb404e9-6459-4b82-9247-914e6b835938 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:41.777007 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6eb404e9-6459-4b82-9247-914e6b835938 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:41.787574 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6eb404e9-6459-4b82-9247-914e6b835938 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.174728 Dec 15 14:19:41.788353 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 695/1478] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:41 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:42.809557 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a3da974c-cabf-4edb-a9c2-ba79f77b6f34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:42.810202 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a3da974c-cabf-4edb-a9c2-ba79f77b6f34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:42.817393 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a3da974c-cabf-4edb-a9c2-ba79f77b6f34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:42.817838 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a3da974c-cabf-4edb-a9c2-ba79f77b6f34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:42.818642 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a3da974c-cabf-4edb-a9c2-ba79f77b6f34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:42.819069 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a3da974c-cabf-4edb-a9c2-ba79f77b6f34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:42.972033 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a3da974c-cabf-4edb-a9c2-ba79f77b6f34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:42.979826 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a3da974c-cabf-4edb-a9c2-ba79f77b6f34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.174193 Dec 15 14:19:42.980369 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 784/1479] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:42 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:44.001602 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a8f93a77-12b6-4794-b9e4-b8f1451e83cb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:44.002376 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a8f93a77-12b6-4794-b9e4-b8f1451e83cb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:44.013351 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8f93a77-12b6-4794-b9e4-b8f1451e83cb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:44.014124 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8f93a77-12b6-4794-b9e4-b8f1451e83cb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:44.015390 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8f93a77-12b6-4794-b9e4-b8f1451e83cb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:44.016069 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8f93a77-12b6-4794-b9e4-b8f1451e83cb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:44.156693 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a8f93a77-12b6-4794-b9e4-b8f1451e83cb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:44.165650 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a8f93a77-12b6-4794-b9e4-b8f1451e83cb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.169911 Dec 15 14:19:44.166228 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 696/1480] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:43 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:45.186714 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-52d94351-61ed-46e4-8643-5abf5424157b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:45.187741 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-52d94351-61ed-46e4-8643-5abf5424157b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:45.197909 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-52d94351-61ed-46e4-8643-5abf5424157b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:45.198356 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-52d94351-61ed-46e4-8643-5abf5424157b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:45.199137 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-52d94351-61ed-46e4-8643-5abf5424157b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:45.199565 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-52d94351-61ed-46e4-8643-5abf5424157b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:45.355679 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-52d94351-61ed-46e4-8643-5abf5424157b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:45.363420 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-52d94351-61ed-46e4-8643-5abf5424157b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.183217 Dec 15 14:19:45.363999 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 785/1481] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:45 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:46.380923 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3f0009b0-fe69-4182-81cd-a372c68617f7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:46.381549 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3f0009b0-fe69-4182-81cd-a372c68617f7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:46.388781 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f0009b0-fe69-4182-81cd-a372c68617f7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:46.389239 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f0009b0-fe69-4182-81cd-a372c68617f7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:46.390045 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f0009b0-fe69-4182-81cd-a372c68617f7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:46.390470 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f0009b0-fe69-4182-81cd-a372c68617f7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:46.530650 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3f0009b0-fe69-4182-81cd-a372c68617f7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:46.538197 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3f0009b0-fe69-4182-81cd-a372c68617f7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.160980 Dec 15 14:19:46.538779 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 697/1482] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:46 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:47.560090 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5b5a6ddf-65a6-4fb5-bb96-b0c3477b25ea tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:47.560756 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5b5a6ddf-65a6-4fb5-bb96-b0c3477b25ea tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:47.568528 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b5a6ddf-65a6-4fb5-bb96-b0c3477b25ea tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:47.569055 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b5a6ddf-65a6-4fb5-bb96-b0c3477b25ea tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:47.570049 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b5a6ddf-65a6-4fb5-bb96-b0c3477b25ea tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:47.570557 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b5a6ddf-65a6-4fb5-bb96-b0c3477b25ea tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:47.722799 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5b5a6ddf-65a6-4fb5-bb96-b0c3477b25ea tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:47.734458 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5b5a6ddf-65a6-4fb5-bb96-b0c3477b25ea tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.178583 Dec 15 14:19:47.735168 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 786/1483] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:47 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:48.757922 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-70f04c1a-f099-4c41-aa19-157e6fb15537 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:48.759062 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-70f04c1a-f099-4c41-aa19-157e6fb15537 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:48.766808 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70f04c1a-f099-4c41-aa19-157e6fb15537 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:48.767307 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70f04c1a-f099-4c41-aa19-157e6fb15537 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:48.768180 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70f04c1a-f099-4c41-aa19-157e6fb15537 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:48.768667 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70f04c1a-f099-4c41-aa19-157e6fb15537 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:48.913097 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-70f04c1a-f099-4c41-aa19-157e6fb15537 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:48.922495 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-70f04c1a-f099-4c41-aa19-157e6fb15537 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.170810 Dec 15 14:19:48.923115 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 698/1484] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:48 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:49.943721 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a2756892-7d81-44e5-9f5d-93f3d3213dce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:49.944408 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a2756892-7d81-44e5-9f5d-93f3d3213dce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:49.953519 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2756892-7d81-44e5-9f5d-93f3d3213dce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:49.954207 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2756892-7d81-44e5-9f5d-93f3d3213dce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:49.955721 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2756892-7d81-44e5-9f5d-93f3d3213dce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:49.956323 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2756892-7d81-44e5-9f5d-93f3d3213dce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:50.106413 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a2756892-7d81-44e5-9f5d-93f3d3213dce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:50.118497 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a2756892-7d81-44e5-9f5d-93f3d3213dce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.180534 Dec 15 14:19:50.119071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 787/1485] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:49 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:51.138905 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-eb029edd-7a1d-4c58-ae42-f3af10c631b1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:51.139701 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-eb029edd-7a1d-4c58-ae42-f3af10c631b1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:51.147281 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb029edd-7a1d-4c58-ae42-f3af10c631b1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:51.147783 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb029edd-7a1d-4c58-ae42-f3af10c631b1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:51.148655 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb029edd-7a1d-4c58-ae42-f3af10c631b1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:51.149139 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb029edd-7a1d-4c58-ae42-f3af10c631b1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:51.292316 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-eb029edd-7a1d-4c58-ae42-f3af10c631b1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:51.300578 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-eb029edd-7a1d-4c58-ae42-f3af10c631b1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.166734 Dec 15 14:19:51.301207 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 699/1486] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:51 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:52.322461 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-28ff354d-b611-4d88-bd87-6250ae29be45 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:52.323455 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-28ff354d-b611-4d88-bd87-6250ae29be45 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:52.335009 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-28ff354d-b611-4d88-bd87-6250ae29be45 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:52.335763 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-28ff354d-b611-4d88-bd87-6250ae29be45 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:52.337098 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-28ff354d-b611-4d88-bd87-6250ae29be45 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:52.337831 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-28ff354d-b611-4d88-bd87-6250ae29be45 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:52.481282 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-28ff354d-b611-4d88-bd87-6250ae29be45 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:52.489483 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-28ff354d-b611-4d88-bd87-6250ae29be45 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.173527 Dec 15 14:19:52.493541 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 788/1487] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:52 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:53.511008 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a2e00935-f115-4024-8716-3b933f8927d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:53.512023 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a2e00935-f115-4024-8716-3b933f8927d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:53.522939 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2e00935-f115-4024-8716-3b933f8927d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:53.523704 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2e00935-f115-4024-8716-3b933f8927d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:53.525003 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2e00935-f115-4024-8716-3b933f8927d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:53.525770 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2e00935-f115-4024-8716-3b933f8927d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:53.687153 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a2e00935-f115-4024-8716-3b933f8927d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:53.695203 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a2e00935-f115-4024-8716-3b933f8927d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.190500 Dec 15 14:19:53.695815 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 700/1488] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:53 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:54.723876 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-882b6f41-ef90-46d2-8514-fa49e67433a9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:54.724967 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-882b6f41-ef90-46d2-8514-fa49e67433a9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:54.736290 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-882b6f41-ef90-46d2-8514-fa49e67433a9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:54.736747 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-882b6f41-ef90-46d2-8514-fa49e67433a9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:54.737538 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-882b6f41-ef90-46d2-8514-fa49e67433a9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:54.738008 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-882b6f41-ef90-46d2-8514-fa49e67433a9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:54.896168 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-882b6f41-ef90-46d2-8514-fa49e67433a9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:54.903898 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-882b6f41-ef90-46d2-8514-fa49e67433a9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.187038 Dec 15 14:19:54.904527 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 789/1489] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:54 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:55.925863 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5cbdcee9-d02f-4334-a786-cf7eaacc3a69 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:55.926801 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5cbdcee9-d02f-4334-a786-cf7eaacc3a69 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:55.937242 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cbdcee9-d02f-4334-a786-cf7eaacc3a69 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:55.937711 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cbdcee9-d02f-4334-a786-cf7eaacc3a69 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:55.938479 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cbdcee9-d02f-4334-a786-cf7eaacc3a69 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:55.938907 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cbdcee9-d02f-4334-a786-cf7eaacc3a69 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:56.108156 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5cbdcee9-d02f-4334-a786-cf7eaacc3a69 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:56.116302 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5cbdcee9-d02f-4334-a786-cf7eaacc3a69 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.196763 Dec 15 14:19:56.117201 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 701/1490] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:55 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:57.133735 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d6c5b61d-547b-4e0e-ba8f-add44a8e2d59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:57.134326 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d6c5b61d-547b-4e0e-ba8f-add44a8e2d59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:57.141376 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d6c5b61d-547b-4e0e-ba8f-add44a8e2d59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:57.141863 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d6c5b61d-547b-4e0e-ba8f-add44a8e2d59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:57.142648 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d6c5b61d-547b-4e0e-ba8f-add44a8e2d59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:57.143068 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d6c5b61d-547b-4e0e-ba8f-add44a8e2d59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:57.280607 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d6c5b61d-547b-4e0e-ba8f-add44a8e2d59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:57.288787 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d6c5b61d-547b-4e0e-ba8f-add44a8e2d59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.158838 Dec 15 14:19:57.289358 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 790/1491] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:57 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:58.314691 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0e2eab44-a0a2-47cb-843b-664bb350b7de tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:58.315457 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0e2eab44-a0a2-47cb-843b-664bb350b7de tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:58.324082 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e2eab44-a0a2-47cb-843b-664bb350b7de tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:58.324649 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e2eab44-a0a2-47cb-843b-664bb350b7de tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:58.325657 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e2eab44-a0a2-47cb-843b-664bb350b7de tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:58.326255 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e2eab44-a0a2-47cb-843b-664bb350b7de tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:58.485491 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0e2eab44-a0a2-47cb-843b-664bb350b7de tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:58.496774 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0e2eab44-a0a2-47cb-843b-664bb350b7de tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.187511 Dec 15 14:19:58.497561 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 702/1492] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:58 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:59.523237 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ecff0c6c-c466-4ab9-b55b-ce4375a59993 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:59.524173 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ecff0c6c-c466-4ab9-b55b-ce4375a59993 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:59.533510 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ecff0c6c-c466-4ab9-b55b-ce4375a59993 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:59.533994 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ecff0c6c-c466-4ab9-b55b-ce4375a59993 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:59.534805 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ecff0c6c-c466-4ab9-b55b-ce4375a59993 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:59.535232 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ecff0c6c-c466-4ab9-b55b-ce4375a59993 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:59.692232 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ecff0c6c-c466-4ab9-b55b-ce4375a59993 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:59.700522 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ecff0c6c-c466-4ab9-b55b-ce4375a59993 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.183620 Dec 15 14:19:59.701095 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 791/1493] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:59 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:00.722598 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f87d2ebc-9f7c-4af6-a646-e009c4cae1ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:00.723601 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f87d2ebc-9f7c-4af6-a646-e009c4cae1ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:00.734152 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f87d2ebc-9f7c-4af6-a646-e009c4cae1ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:00.734601 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f87d2ebc-9f7c-4af6-a646-e009c4cae1ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:00.735391 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f87d2ebc-9f7c-4af6-a646-e009c4cae1ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:00.735832 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f87d2ebc-9f7c-4af6-a646-e009c4cae1ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:00.883771 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f87d2ebc-9f7c-4af6-a646-e009c4cae1ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:00.891865 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f87d2ebc-9f7c-4af6-a646-e009c4cae1ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.175993 Dec 15 14:20:00.892456 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 703/1494] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:00 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:01.912727 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c3940493-3e6e-4b54-9802-740a965e2085 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:01.913695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c3940493-3e6e-4b54-9802-740a965e2085 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:01.925120 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3940493-3e6e-4b54-9802-740a965e2085 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:01.925963 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3940493-3e6e-4b54-9802-740a965e2085 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:01.927316 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3940493-3e6e-4b54-9802-740a965e2085 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:01.928046 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3940493-3e6e-4b54-9802-740a965e2085 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:02.073381 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c3940493-3e6e-4b54-9802-740a965e2085 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:02.082057 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c3940493-3e6e-4b54-9802-740a965e2085 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.175585 Dec 15 14:20:02.084274 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 792/1495] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:01 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:03.102737 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0fa9b588-90b6-4b5b-9665-9370103a416d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:03.103372 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0fa9b588-90b6-4b5b-9665-9370103a416d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:03.110429 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fa9b588-90b6-4b5b-9665-9370103a416d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:03.110892 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fa9b588-90b6-4b5b-9665-9370103a416d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:03.111894 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fa9b588-90b6-4b5b-9665-9370103a416d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:03.112634 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fa9b588-90b6-4b5b-9665-9370103a416d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:03.255629 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0fa9b588-90b6-4b5b-9665-9370103a416d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:03.264165 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0fa9b588-90b6-4b5b-9665-9370103a416d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.165121 Dec 15 14:20:03.264935 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 704/1496] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:03 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:04.283010 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-04f08d69-330f-4447-aee3-77e5a5b678e9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:04.283644 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-04f08d69-330f-4447-aee3-77e5a5b678e9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:04.290543 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-04f08d69-330f-4447-aee3-77e5a5b678e9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:04.291028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-04f08d69-330f-4447-aee3-77e5a5b678e9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:04.291814 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-04f08d69-330f-4447-aee3-77e5a5b678e9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:04.292254 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-04f08d69-330f-4447-aee3-77e5a5b678e9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:04.442629 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-04f08d69-330f-4447-aee3-77e5a5b678e9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:04.455476 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-04f08d69-330f-4447-aee3-77e5a5b678e9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.176274 Dec 15 14:20:04.456328 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 793/1497] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:04 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:05.483694 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-982cd55a-2608-403e-9254-3acc510ee88d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:05.484443 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-982cd55a-2608-403e-9254-3acc510ee88d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:05.492880 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-982cd55a-2608-403e-9254-3acc510ee88d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:05.493341 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-982cd55a-2608-403e-9254-3acc510ee88d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:05.494185 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-982cd55a-2608-403e-9254-3acc510ee88d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:05.494625 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-982cd55a-2608-403e-9254-3acc510ee88d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:05.645325 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-982cd55a-2608-403e-9254-3acc510ee88d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:05.653645 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-982cd55a-2608-403e-9254-3acc510ee88d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.178158 Dec 15 14:20:05.654245 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 705/1498] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:05 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:06.675936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ab065cd3-9fea-4e02-8277-a2eb8c057e3f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:06.676902 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ab065cd3-9fea-4e02-8277-a2eb8c057e3f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:06.687410 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ab065cd3-9fea-4e02-8277-a2eb8c057e3f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:06.687860 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ab065cd3-9fea-4e02-8277-a2eb8c057e3f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:06.688703 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ab065cd3-9fea-4e02-8277-a2eb8c057e3f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:06.689145 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ab065cd3-9fea-4e02-8277-a2eb8c057e3f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:06.837540 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ab065cd3-9fea-4e02-8277-a2eb8c057e3f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:06.845876 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ab065cd3-9fea-4e02-8277-a2eb8c057e3f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.176462 Dec 15 14:20:06.846454 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 794/1499] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:06 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:07.871330 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1623e99f-2783-4a54-84b6-d1f78fff3b99 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:07.872245 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1623e99f-2783-4a54-84b6-d1f78fff3b99 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:07.882890 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1623e99f-2783-4a54-84b6-d1f78fff3b99 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:07.883637 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1623e99f-2783-4a54-84b6-d1f78fff3b99 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:07.884948 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1623e99f-2783-4a54-84b6-d1f78fff3b99 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:07.885754 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1623e99f-2783-4a54-84b6-d1f78fff3b99 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:08.034029 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1623e99f-2783-4a54-84b6-d1f78fff3b99 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:08.042405 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1623e99f-2783-4a54-84b6-d1f78fff3b99 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.176757 Dec 15 14:20:08.042947 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 706/1500] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:07 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:09.064986 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-15a18c5e-c9ed-41a0-b780-92c1cd78d3aa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:09.065713 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-15a18c5e-c9ed-41a0-b780-92c1cd78d3aa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:09.074238 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15a18c5e-c9ed-41a0-b780-92c1cd78d3aa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:09.074812 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15a18c5e-c9ed-41a0-b780-92c1cd78d3aa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:09.075801 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15a18c5e-c9ed-41a0-b780-92c1cd78d3aa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:09.076403 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15a18c5e-c9ed-41a0-b780-92c1cd78d3aa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:09.229333 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-15a18c5e-c9ed-41a0-b780-92c1cd78d3aa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:09.237855 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-15a18c5e-c9ed-41a0-b780-92c1cd78d3aa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.179590 Dec 15 14:20:09.238465 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 795/1501] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:09 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:09.488129 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:20:09.488966 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:20:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:20:10.260215 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1ad5383c-0539-4a52-90d9-46a220e5cf2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:10.261193 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1ad5383c-0539-4a52-90d9-46a220e5cf2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:10.269651 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ad5383c-0539-4a52-90d9-46a220e5cf2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:10.270185 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ad5383c-0539-4a52-90d9-46a220e5cf2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:10.270964 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ad5383c-0539-4a52-90d9-46a220e5cf2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:10.271392 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ad5383c-0539-4a52-90d9-46a220e5cf2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:10.423195 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1ad5383c-0539-4a52-90d9-46a220e5cf2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:10.435960 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1ad5383c-0539-4a52-90d9-46a220e5cf2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.181925 Dec 15 14:20:10.436955 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 707/1502] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:10 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:20:11.054118 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:20:11.055139 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:20:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:20:11.456272 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2c35ea3f-7038-4f6a-b68f-42347fd73b73 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:11.456853 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2c35ea3f-7038-4f6a-b68f-42347fd73b73 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:11.463731 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c35ea3f-7038-4f6a-b68f-42347fd73b73 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:11.464167 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c35ea3f-7038-4f6a-b68f-42347fd73b73 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:11.464946 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c35ea3f-7038-4f6a-b68f-42347fd73b73 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:11.465380 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c35ea3f-7038-4f6a-b68f-42347fd73b73 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:11.609468 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2c35ea3f-7038-4f6a-b68f-42347fd73b73 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:11.617846 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2c35ea3f-7038-4f6a-b68f-42347fd73b73 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.166605 Dec 15 14:20:11.618442 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 796/1503] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:11 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:12.635552 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ccb11be3-c3fa-4d37-ab57-182a968de4ba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:12.636206 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ccb11be3-c3fa-4d37-ab57-182a968de4ba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:12.643458 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccb11be3-c3fa-4d37-ab57-182a968de4ba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:12.643905 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccb11be3-c3fa-4d37-ab57-182a968de4ba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:12.644715 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccb11be3-c3fa-4d37-ab57-182a968de4ba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:12.645151 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccb11be3-c3fa-4d37-ab57-182a968de4ba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:12.793155 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ccb11be3-c3fa-4d37-ab57-182a968de4ba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:12.801652 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ccb11be3-c3fa-4d37-ab57-182a968de4ba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.169987 Dec 15 14:20:12.802250 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 708/1504] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:12 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:13.822206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5489c314-0978-44a3-a59d-500da7b5fe97 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:13.822802 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5489c314-0978-44a3-a59d-500da7b5fe97 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:13.830709 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5489c314-0978-44a3-a59d-500da7b5fe97 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:13.831160 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5489c314-0978-44a3-a59d-500da7b5fe97 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:13.831998 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5489c314-0978-44a3-a59d-500da7b5fe97 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:13.832430 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5489c314-0978-44a3-a59d-500da7b5fe97 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:13.986120 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5489c314-0978-44a3-a59d-500da7b5fe97 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:13.994631 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5489c314-0978-44a3-a59d-500da7b5fe97 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.176219 Dec 15 14:20:13.995224 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 797/1505] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:13 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:15.016286 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2d4d3a2d-a43c-467d-9b35-1befbe02e1c8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:15.018222 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2d4d3a2d-a43c-467d-9b35-1befbe02e1c8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:15.029063 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d4d3a2d-a43c-467d-9b35-1befbe02e1c8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:15.030009 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d4d3a2d-a43c-467d-9b35-1befbe02e1c8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:15.031200 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d4d3a2d-a43c-467d-9b35-1befbe02e1c8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:15.032193 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d4d3a2d-a43c-467d-9b35-1befbe02e1c8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:15.183545 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2d4d3a2d-a43c-467d-9b35-1befbe02e1c8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:15.192156 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2d4d3a2d-a43c-467d-9b35-1befbe02e1c8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.182381 Dec 15 14:20:15.192705 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 709/1506] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:15 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:16.215932 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-560b9a8c-28c7-4bc7-975e-d5a5d79d7e78 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:16.217038 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-560b9a8c-28c7-4bc7-975e-d5a5d79d7e78 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:16.227175 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-560b9a8c-28c7-4bc7-975e-d5a5d79d7e78 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:16.227865 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-560b9a8c-28c7-4bc7-975e-d5a5d79d7e78 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:16.228732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-560b9a8c-28c7-4bc7-975e-d5a5d79d7e78 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:16.229167 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-560b9a8c-28c7-4bc7-975e-d5a5d79d7e78 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:16.371686 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-560b9a8c-28c7-4bc7-975e-d5a5d79d7e78 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:16.379487 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-560b9a8c-28c7-4bc7-975e-d5a5d79d7e78 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.168626 Dec 15 14:20:16.380283 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 798/1507] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:16 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:16.717626 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1415bffb-179a-443e-877e-2c93a7502f17 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:16.718163 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1415bffb-179a-443e-877e-2c93a7502f17 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:16.724549 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1415bffb-179a-443e-877e-2c93a7502f17 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:16.724994 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1415bffb-179a-443e-877e-2c93a7502f17 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:16.725804 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1415bffb-179a-443e-877e-2c93a7502f17 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:16.726238 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1415bffb-179a-443e-877e-2c93a7502f17 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:16.760555 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1415bffb-179a-443e-877e-2c93a7502f17 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:20:16.767594 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.compute.api [None req-1415bffb-179a-443e-877e-2c93a7502f17 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Working on deleting snapshot 61f383f7-04bd-4b79-a148-91ce9759d8bd from shelved instance... Dec 15 14:20:17.396438 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-30345403-944f-45bc-b174-0142c101d30c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:17.397066 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-30345403-944f-45bc-b174-0142c101d30c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:17.403942 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-30345403-944f-45bc-b174-0142c101d30c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:17.404387 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-30345403-944f-45bc-b174-0142c101d30c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:17.405170 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-30345403-944f-45bc-b174-0142c101d30c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:17.405602 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-30345403-944f-45bc-b174-0142c101d30c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:17.485848 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1415bffb-179a-443e-877e-2c93a7502f17 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Doing local delete in cell ff103318-e65e-4db9-8afc-ec27a2dfc0ea(cell1) {{(pid=116103) _delete /opt/stack/nova/nova/compute/api.py:2439}} Dec 15 14:20:17.486589 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1415bffb-179a-443e-877e-2c93a7502f17 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:17.487032 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1415bffb-179a-443e-877e-2c93a7502f17 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:17.487456 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.compute.api [None req-1415bffb-179a-443e-877e-2c93a7502f17 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Dec 15 14:20:17.494390 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-1415bffb-179a-443e-877e-2c93a7502f17 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] deallocate_for_instance() {{(pid=116103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1676}} Dec 15 14:20:17.586625 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-30345403-944f-45bc-b174-0142c101d30c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:17.594709 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-30345403-944f-45bc-b174-0142c101d30c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.201646 Dec 15 14:20:17.595500 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 799/1508] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:17 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:20:18.456315 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-a3ea644a-1be9-4b44-ac26-2420e8622151 req-7c2c1794-2374-4cfe-99d8-b5fb58366025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc65306-f419-4eac-97a2-407c5d6744da", "name": "network-vif-deleted", "tag": "7989001b-405b-4c40-b4ff-1aeb457e4e50"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:18.458021 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:20:18.458021 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:20:18.458928 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-1415bffb-179a-443e-877e-2c93a7502f17 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Updating instance_info_cache with network_info: [] {{(pid=116103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 15 14:20:18.465324 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-a3ea644a-1be9-4b44-ac26-2420e8622151 req-7c2c1794-2374-4cfe-99d8-b5fb58366025 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:18.465836 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-a3ea644a-1be9-4b44-ac26-2420e8622151 req-7c2c1794-2374-4cfe-99d8-b5fb58366025 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:18.477662 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.compute.server_external_events [req-a3ea644a-1be9-4b44-ac26-2420e8622151 req-7c2c1794-2374-4cfe-99d8-b5fb58366025 service nova] Unable to find a host for instance fcc65306-f419-4eac-97a2-407c5d6744da. Dropping event network-vif-deleted {{(pid=116104) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 15 14:20:18.478630 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-a3ea644a-1be9-4b44-ac26-2420e8622151 req-7c2c1794-2374-4cfe-99d8-b5fb58366025 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.028704 Dec 15 14:20:18.479451 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 800/1509] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:20:18 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 15 14:20:18.612071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-42250772-27a7-45dd-8654-6a861da5eeee tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:18.612763 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-42250772-27a7-45dd-8654-6a861da5eeee tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:18.618583 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42250772-27a7-45dd-8654-6a861da5eeee tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:18.619021 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42250772-27a7-45dd-8654-6a861da5eeee tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:18.619751 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42250772-27a7-45dd-8654-6a861da5eeee tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:18.620378 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42250772-27a7-45dd-8654-6a861da5eeee tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:18.687222 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.scheduler.client.report [None req-1415bffb-179a-443e-877e-2c93a7502f17 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Deleted allocations for instance fcc65306-f419-4eac-97a2-407c5d6744da Dec 15 14:20:18.785658 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-42250772-27a7-45dd-8654-6a861da5eeee tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:18.794270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-42250772-27a7-45dd-8654-6a861da5eeee tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.186094 Dec 15 14:20:18.795108 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 801/1510] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:18 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:18.845814 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1415bffb-179a-443e-877e-2c93a7502f17 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 204 len: 0 microversion: 2.20 time: 2.131812 Dec 15 14:20:18.846411 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 710/1511] 10.222.0.42 () {60 vars in 1279 bytes} [Wed Dec 15 14:20:16 2021] DELETE /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 0 bytes in 2133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 14:20:18.854966 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ae349286-d9e7-4021-860e-13c9486b718a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:18.855575 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ae349286-d9e7-4021-860e-13c9486b718a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:18.861963 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ae349286-d9e7-4021-860e-13c9486b718a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:18.862409 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ae349286-d9e7-4021-860e-13c9486b718a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:18.863210 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ae349286-d9e7-4021-860e-13c9486b718a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:18.863645 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ae349286-d9e7-4021-860e-13c9486b718a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:18.877279 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-ae349286-d9e7-4021-860e-13c9486b718a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] HTTP exception thrown: Instance fcc65306-f419-4eac-97a2-407c5d6744da could not be found. Dec 15 14:20:18.877899 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ae349286-d9e7-4021-860e-13c9486b718a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Returning 404 to user: Instance fcc65306-f419-4eac-97a2-407c5d6744da could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:20:18.878725 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ae349286-d9e7-4021-860e-13c9486b718a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 404 len: 111 microversion: 2.20 time: 0.027695 Dec 15 14:20:18.879266 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 802/1512] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:20:18 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 15 14:20:18.888577 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1eb309f2-7b6b-4c59-883b-961ac9703ed2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '.version_select at 0x7faa3c87fca0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:18.907912 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1eb309f2-7b6b-4c59-883b-961ac9703ed2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-46775383" status: 204 len: 0 microversion: 2.20 time: 0.023502 Dec 15 14:20:18.908518 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 711/1513] 10.222.0.42 () {60 vars in 1255 bytes} [Wed Dec 15 14:20:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-46775383 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 14:20:19.697844 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c207a608-4fe5-412a-a664-9f0051701a38 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'create', calling method: .version_select at 0x7faa3c933d30>, body: {"keypair": {"name": "tempest-keypair-1975655170"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:19.713961 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-c207a608-4fe5-412a-a664-9f0051701a38 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Getting quotas for project b5979590d3d84996a1c7bd99feffc601. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:20:19.718801 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-c207a608-4fe5-412a-a664-9f0051701a38 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Getting quotas for user c39f58b934374c718793574870072027 and project b5979590d3d84996a1c7bd99feffc601. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:20:19.812355 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a7d65955-03f2-4eda-a2d4-286856d5fa63 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:19.813126 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a7d65955-03f2-4eda-a2d4-286856d5fa63 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:19.820169 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7d65955-03f2-4eda-a2d4-286856d5fa63 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:19.820611 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7d65955-03f2-4eda-a2d4-286856d5fa63 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:19.821379 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7d65955-03f2-4eda-a2d4-286856d5fa63 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:19.821845 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7d65955-03f2-4eda-a2d4-286856d5fa63 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:19.958382 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-c207a608-4fe5-412a-a664-9f0051701a38 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Getting quotas for project b5979590d3d84996a1c7bd99feffc601. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:20:19.962469 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-c207a608-4fe5-412a-a664-9f0051701a38 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Getting quotas for user c39f58b934374c718793574870072027 and project b5979590d3d84996a1c7bd99feffc601. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:20:19.977310 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a7d65955-03f2-4eda-a2d4-286856d5fa63 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:19.977658 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c207a608-4fe5-412a-a664-9f0051701a38 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.283733 Dec 15 14:20:19.978327 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 803/1514] 10.222.0.42 () {62 vars in 1198 bytes} [Wed Dec 15 14:20:19 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 285 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 15 14:20:19.985772 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a7d65955-03f2-4eda-a2d4-286856d5fa63 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.177335 Dec 15 14:20:19.986719 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 712/1515] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:19 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:21.003953 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c9efcf18-4646-4ce9-8959-333a1f6b22a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:21.004538 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c9efcf18-4646-4ce9-8959-333a1f6b22a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:21.011560 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c9efcf18-4646-4ce9-8959-333a1f6b22a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:21.012013 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c9efcf18-4646-4ce9-8959-333a1f6b22a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:21.013067 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c9efcf18-4646-4ce9-8959-333a1f6b22a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:21.013488 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c9efcf18-4646-4ce9-8959-333a1f6b22a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:21.240185 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c9efcf18-4646-4ce9-8959-333a1f6b22a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:21.248289 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c9efcf18-4646-4ce9-8959-333a1f6b22a5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.248816 Dec 15 14:20:21.248990 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 804/1516] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:20 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:21.670800 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1b677d4f-32ea-4af6-8315-151ead8a38a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2135050850", "imageRef": "9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e188c8ca-d22a-41f7-a1cb-0eaacf67cdea"}], "security_groups": [{"name": "tempest-securitygroup--1040546831"}], "key_name": "tempest-keypair-1975655170", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:21.780439 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-1b677d4f-32ea-4af6-8315-151ead8a38a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] validate_networks() for [('e188c8ca-d22a-41f7-a1cb-0eaacf67cdea', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:20:22.261463 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-1b677d4f-32ea-4af6-8315-151ead8a38a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:20:22.262103 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-1b677d4f-32ea-4af6-8315-151ead8a38a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:20:22.262743 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-1b677d4f-32ea-4af6-8315-151ead8a38a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:20:22.263314 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-1b677d4f-32ea-4af6-8315-151ead8a38a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:20:22.263889 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-1b677d4f-32ea-4af6-8315-151ead8a38a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:20:22.268078 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c512f2db-337b-4b93-92e5-348af06b5246 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:22.268706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c512f2db-337b-4b93-92e5-348af06b5246 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:22.276091 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b677d4f-32ea-4af6-8315-151ead8a38a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:22.276672 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b677d4f-32ea-4af6-8315-151ead8a38a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:22.277252 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c512f2db-337b-4b93-92e5-348af06b5246 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:22.277842 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b677d4f-32ea-4af6-8315-151ead8a38a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:22.277982 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c512f2db-337b-4b93-92e5-348af06b5246 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:22.278355 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b677d4f-32ea-4af6-8315-151ead8a38a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:22.278923 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c512f2db-337b-4b93-92e5-348af06b5246 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:22.279582 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c512f2db-337b-4b93-92e5-348af06b5246 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:22.300476 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-1b677d4f-32ea-4af6-8315-151ead8a38a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Getting quotas for project b5979590d3d84996a1c7bd99feffc601. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:20:22.304910 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-1b677d4f-32ea-4af6-8315-151ead8a38a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Getting quotas for user c39f58b934374c718793574870072027 and project b5979590d3d84996a1c7bd99feffc601. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:20:22.316980 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1b677d4f-32ea-4af6-8315-151ead8a38a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:20:22.319449 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1b677d4f-32ea-4af6-8315-151ead8a38a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:20:22.370639 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1b677d4f-32ea-4af6-8315-151ead8a38a1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.703691 Dec 15 14:20:22.371493 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 713/1517] 10.222.0.42 () {62 vars in 1187 bytes} [Wed Dec 15 14:20:21 2021] POST /compute/v2.1/servers => generated 402 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 14:20:22.381467 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d215594d-c776-4f41-ad27-da38a30d72a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:22.382110 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d215594d-c776-4f41-ad27-da38a30d72a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:22.451895 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d215594d-c776-4f41-ad27-da38a30d72a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:22.456046 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c512f2db-337b-4b93-92e5-348af06b5246 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:22.460784 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d215594d-c776-4f41-ad27-da38a30d72a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:22.462371 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d215594d-c776-4f41-ad27-da38a30d72a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:22.463454 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d215594d-c776-4f41-ad27-da38a30d72a9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b" status: 200 len: 1282 microversion: 2.20 time: 0.085913 Dec 15 14:20:22.463870 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c512f2db-337b-4b93-92e5-348af06b5246 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.200888 Dec 15 14:20:22.464357 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 714/1518] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:20:22 2021] GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b => generated 1282 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:20:22.464574 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 805/1519] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:22 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:23.481758 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e8e1fd10-20e0-4334-b23b-34ffa616cc34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:23.482409 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e8e1fd10-20e0-4334-b23b-34ffa616cc34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:23.482701 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5e466f86-3b92-4d65-925a-ad566047f602 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:23.483874 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5e466f86-3b92-4d65-925a-ad566047f602 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:23.489146 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8e1fd10-20e0-4334-b23b-34ffa616cc34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:23.489868 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8e1fd10-20e0-4334-b23b-34ffa616cc34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:23.490683 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8e1fd10-20e0-4334-b23b-34ffa616cc34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:23.491260 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8e1fd10-20e0-4334-b23b-34ffa616cc34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:23.492839 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e466f86-3b92-4d65-925a-ad566047f602 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:23.494750 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e466f86-3b92-4d65-925a-ad566047f602 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:23.495694 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e466f86-3b92-4d65-925a-ad566047f602 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:23.496141 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e466f86-3b92-4d65-925a-ad566047f602 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:23.607166 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5e466f86-3b92-4d65-925a-ad566047f602 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:23.615684 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5e466f86-3b92-4d65-925a-ad566047f602 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:23.617100 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5e466f86-3b92-4d65-925a-ad566047f602 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:23.618300 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5e466f86-3b92-4d65-925a-ad566047f602 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b" status: 200 len: 1340 microversion: 2.20 time: 0.139406 Dec 15 14:20:23.618898 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 806/1520] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:20:23 2021] GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b => generated 1340 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:20:23.763059 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e8e1fd10-20e0-4334-b23b-34ffa616cc34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:23.773276 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e8e1fd10-20e0-4334-b23b-34ffa616cc34 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.295589 Dec 15 14:20:23.783223 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 715/1521] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:23 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:24.639197 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-02572702-bb8f-463e-86a5-f527ab93447f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:24.639857 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-02572702-bb8f-463e-86a5-f527ab93447f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:24.648059 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-02572702-bb8f-463e-86a5-f527ab93447f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:24.648853 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-02572702-bb8f-463e-86a5-f527ab93447f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:24.650281 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-02572702-bb8f-463e-86a5-f527ab93447f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:24.651387 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-02572702-bb8f-463e-86a5-f527ab93447f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:24.791236 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5b0323bc-c670-47c3-b712-d8698786a374 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:24.791919 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5b0323bc-c670-47c3-b712-d8698786a374 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:24.799168 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b0323bc-c670-47c3-b712-d8698786a374 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:24.799918 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b0323bc-c670-47c3-b712-d8698786a374 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:24.800927 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b0323bc-c670-47c3-b712-d8698786a374 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:24.801529 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b0323bc-c670-47c3-b712-d8698786a374 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:24.968710 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-02572702-bb8f-463e-86a5-f527ab93447f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:24.984402 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-02572702-bb8f-463e-86a5-f527ab93447f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:24.987220 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-02572702-bb8f-463e-86a5-f527ab93447f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:24.989095 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-02572702-bb8f-463e-86a5-f527ab93447f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b" status: 200 len: 1408 microversion: 2.20 time: 0.355170 Dec 15 14:20:24.989904 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 807/1522] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:20:24 2021] GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b => generated 1408 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:20:25.095752 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5b0323bc-c670-47c3-b712-d8698786a374 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:25.104448 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5b0323bc-c670-47c3-b712-d8698786a374 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.317005 Dec 15 14:20:25.105049 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 716/1523] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:24 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:25.197179 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-2682ff41-985f-4c2d-8473-32a4c71aeb1e req-5a766e09-eddb-4119-baf1-b5af6c392970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52081f6-a4da-417f-8092-e26d5315a39b", "tag": "3be25b39-2c2c-49c8-8aae-df0e43911b97"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:25.199473 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:20:25.199473 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:20:25.209676 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-2682ff41-985f-4c2d-8473-32a4c71aeb1e req-5a766e09-eddb-4119-baf1-b5af6c392970 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:25.210343 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-2682ff41-985f-4c2d-8473-32a4c71aeb1e req-5a766e09-eddb-4119-baf1-b5af6c392970 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:25.226885 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-2682ff41-985f-4c2d-8473-32a4c71aeb1e req-5a766e09-eddb-4119-baf1-b5af6c392970 service nova] Creating event network-changed:3be25b39-2c2c-49c8-8aae-df0e43911b97 for instance a52081f6-a4da-417f-8092-e26d5315a39b on hv-cinder-82182 Dec 15 14:20:25.232827 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: ERROR oslo.messaging._drivers.impl_rabbit [req-2682ff41-985f-4c2d-8473-32a4c71aeb1e req-5a766e09-eddb-4119-baf1-b5af6c392970 service nova] [a2b14dff-eb4a-4e0e-8c5e-33f3e4e9e959] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 14:20:26.007720 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-57799ed6-480a-4de2-9e33-258a98616e50 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:26.008354 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-57799ed6-480a-4de2-9e33-258a98616e50 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:26.015206 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57799ed6-480a-4de2-9e33-258a98616e50 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:26.015653 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57799ed6-480a-4de2-9e33-258a98616e50 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:26.016950 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57799ed6-480a-4de2-9e33-258a98616e50 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:26.017393 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57799ed6-480a-4de2-9e33-258a98616e50 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:26.161490 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-57799ed6-480a-4de2-9e33-258a98616e50 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:26.174344 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-57799ed6-480a-4de2-9e33-258a98616e50 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:26.176501 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-57799ed6-480a-4de2-9e33-258a98616e50 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:26.178276 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-57799ed6-480a-4de2-9e33-258a98616e50 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b" status: 200 len: 1408 microversion: 2.20 time: 0.174129 Dec 15 14:20:26.179053 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 717/1524] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:20:26 2021] GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:20:26.183227 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8934f17f-c8de-46f3-a1b5-e1a46819dd59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:26.183828 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8934f17f-c8de-46f3-a1b5-e1a46819dd59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:26.190056 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8934f17f-c8de-46f3-a1b5-e1a46819dd59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:26.190510 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8934f17f-c8de-46f3-a1b5-e1a46819dd59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:26.191290 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8934f17f-c8de-46f3-a1b5-e1a46819dd59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:26.191723 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8934f17f-c8de-46f3-a1b5-e1a46819dd59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:26.257361 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [req-2682ff41-985f-4c2d-8473-32a4c71aeb1e req-5a766e09-eddb-4119-baf1-b5af6c392970 service nova] [a2b14dff-eb4a-4e0e-8c5e-33f3e4e9e959] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 51310. Dec 15 14:20:26.261915 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-2682ff41-985f-4c2d-8473-32a4c71aeb1e req-5a766e09-eddb-4119-baf1-b5af6c392970 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.068637 Dec 15 14:20:26.262737 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 808/1525] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:20:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:20:26.382370 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8934f17f-c8de-46f3-a1b5-e1a46819dd59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:26.390211 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8934f17f-c8de-46f3-a1b5-e1a46819dd59 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.210234 Dec 15 14:20:26.390828 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 718/1526] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:26 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:26.658284 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f67216f9-f6e1-438a-8ff6-f9379c6faf75 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:26.658934 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f67216f9-f6e1-438a-8ff6-f9379c6faf75 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:26.665537 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f67216f9-f6e1-438a-8ff6-f9379c6faf75 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:26.666111 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f67216f9-f6e1-438a-8ff6-f9379c6faf75 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:26.667016 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f67216f9-f6e1-438a-8ff6-f9379c6faf75 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:26.667520 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f67216f9-f6e1-438a-8ff6-f9379c6faf75 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:26.693092 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f67216f9-f6e1-438a-8ff6-f9379c6faf75 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:20:26.774528 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f67216f9-f6e1-438a-8ff6-f9379c6faf75 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "DELETE /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 204 len: 0 microversion: 2.1 time: 0.121271 Dec 15 14:20:26.775340 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 809/1527] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:20:26 2021] DELETE /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:20:26.783915 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b905778a-6e39-4278-9401-756a28f68104 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:26.784530 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b905778a-6e39-4278-9401-756a28f68104 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:26.790902 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b905778a-6e39-4278-9401-756a28f68104 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:26.791421 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b905778a-6e39-4278-9401-756a28f68104 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:26.792266 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b905778a-6e39-4278-9401-756a28f68104 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:26.792787 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b905778a-6e39-4278-9401-756a28f68104 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:26.950534 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b905778a-6e39-4278-9401-756a28f68104 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:26.959285 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b905778a-6e39-4278-9401-756a28f68104 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.179642 Dec 15 14:20:26.960064 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 719/1528] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:26 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:20:27.202810 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2b9456e3-2c68-437a-9e06-85fbcd1914ff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:27.204411 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2b9456e3-2c68-437a-9e06-85fbcd1914ff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:27.210719 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b9456e3-2c68-437a-9e06-85fbcd1914ff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:27.211172 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b9456e3-2c68-437a-9e06-85fbcd1914ff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:27.211959 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b9456e3-2c68-437a-9e06-85fbcd1914ff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:27.212393 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b9456e3-2c68-437a-9e06-85fbcd1914ff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:27.353678 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2b9456e3-2c68-437a-9e06-85fbcd1914ff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:27.364158 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2b9456e3-2c68-437a-9e06-85fbcd1914ff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:27.365678 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2b9456e3-2c68-437a-9e06-85fbcd1914ff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:27.366807 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2b9456e3-2c68-437a-9e06-85fbcd1914ff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b" status: 200 len: 1408 microversion: 2.20 time: 0.171923 Dec 15 14:20:27.367349 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 810/1529] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:20:27 2021] GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:20:27.408197 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0da3e964-25fa-49ba-8b17-0dabfdb0fa80 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:27.409238 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0da3e964-25fa-49ba-8b17-0dabfdb0fa80 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:27.419695 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0da3e964-25fa-49ba-8b17-0dabfdb0fa80 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:27.420197 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0da3e964-25fa-49ba-8b17-0dabfdb0fa80 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:27.421229 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0da3e964-25fa-49ba-8b17-0dabfdb0fa80 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:27.421965 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0da3e964-25fa-49ba-8b17-0dabfdb0fa80 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:27.566629 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0da3e964-25fa-49ba-8b17-0dabfdb0fa80 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:27.576248 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0da3e964-25fa-49ba-8b17-0dabfdb0fa80 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.172054 Dec 15 14:20:27.577013 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 720/1530] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:27 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:27.980387 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a76a9111-707f-446b-b38c-6bbb61cb9921 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:27.981399 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a76a9111-707f-446b-b38c-6bbb61cb9921 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:27.989905 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a76a9111-707f-446b-b38c-6bbb61cb9921 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:27.990367 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a76a9111-707f-446b-b38c-6bbb61cb9921 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:27.991149 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a76a9111-707f-446b-b38c-6bbb61cb9921 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:27.991587 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a76a9111-707f-446b-b38c-6bbb61cb9921 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:28.150948 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a76a9111-707f-446b-b38c-6bbb61cb9921 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:28.163413 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a76a9111-707f-446b-b38c-6bbb61cb9921 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.189203 Dec 15 14:20:28.164418 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 811/1531] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:27 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:28.385707 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-792cbc07-6cc0-493c-a58d-2b19d9f1255d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:28.386251 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-792cbc07-6cc0-493c-a58d-2b19d9f1255d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:28.395243 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-792cbc07-6cc0-493c-a58d-2b19d9f1255d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:28.395970 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-792cbc07-6cc0-493c-a58d-2b19d9f1255d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:28.397311 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-792cbc07-6cc0-493c-a58d-2b19d9f1255d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:28.398065 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-792cbc07-6cc0-493c-a58d-2b19d9f1255d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:28.599731 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1bfb27cd-8177-4d8c-b7e4-dea7ee1f9b1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:28.600318 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1bfb27cd-8177-4d8c-b7e4-dea7ee1f9b1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:28.607492 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1bfb27cd-8177-4d8c-b7e4-dea7ee1f9b1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:28.607967 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1bfb27cd-8177-4d8c-b7e4-dea7ee1f9b1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:28.608743 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1bfb27cd-8177-4d8c-b7e4-dea7ee1f9b1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:28.610003 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1bfb27cd-8177-4d8c-b7e4-dea7ee1f9b1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:28.617155 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-792cbc07-6cc0-493c-a58d-2b19d9f1255d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:28.629602 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-792cbc07-6cc0-493c-a58d-2b19d9f1255d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:28.631588 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-792cbc07-6cc0-493c-a58d-2b19d9f1255d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:28.632717 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-792cbc07-6cc0-493c-a58d-2b19d9f1255d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b" status: 200 len: 1408 microversion: 2.20 time: 0.251248 Dec 15 14:20:28.633289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 721/1532] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:20:28 2021] GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:20:28.759704 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1bfb27cd-8177-4d8c-b7e4-dea7ee1f9b1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:28.767808 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1bfb27cd-8177-4d8c-b7e4-dea7ee1f9b1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.172228 Dec 15 14:20:28.768547 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 812/1533] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:28 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:29.188698 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cbca1119-e509-4cca-92ca-c7684055baf0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:29.189674 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cbca1119-e509-4cca-92ca-c7684055baf0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:29.196599 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cbca1119-e509-4cca-92ca-c7684055baf0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:29.197052 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cbca1119-e509-4cca-92ca-c7684055baf0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:29.197876 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cbca1119-e509-4cca-92ca-c7684055baf0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:29.198318 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cbca1119-e509-4cca-92ca-c7684055baf0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:29.371369 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cbca1119-e509-4cca-92ca-c7684055baf0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:29.385526 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cbca1119-e509-4cca-92ca-c7684055baf0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.202919 Dec 15 14:20:29.386610 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 722/1534] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:29 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:29.658851 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ca23381a-5242-4671-a3a1-1452b086a669 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:29.659800 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ca23381a-5242-4671-a3a1-1452b086a669 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:29.668045 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca23381a-5242-4671-a3a1-1452b086a669 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:29.668595 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca23381a-5242-4671-a3a1-1452b086a669 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:29.670016 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca23381a-5242-4671-a3a1-1452b086a669 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:29.670016 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca23381a-5242-4671-a3a1-1452b086a669 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:29.784525 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e202897a-4d5f-404a-ad58-027668c54c6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:29.785138 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e202897a-4d5f-404a-ad58-027668c54c6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:29.791803 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e202897a-4d5f-404a-ad58-027668c54c6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:29.792254 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e202897a-4d5f-404a-ad58-027668c54c6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:29.793239 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e202897a-4d5f-404a-ad58-027668c54c6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:29.793593 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e202897a-4d5f-404a-ad58-027668c54c6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:29.822182 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ca23381a-5242-4671-a3a1-1452b086a669 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:29.830611 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ca23381a-5242-4671-a3a1-1452b086a669 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:29.832132 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ca23381a-5242-4671-a3a1-1452b086a669 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:29.833281 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ca23381a-5242-4671-a3a1-1452b086a669 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b" status: 200 len: 1408 microversion: 2.20 time: 0.180551 Dec 15 14:20:29.833851 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 813/1535] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:20:29 2021] GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:20:29.934292 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e202897a-4d5f-404a-ad58-027668c54c6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:29.942708 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e202897a-4d5f-404a-ad58-027668c54c6d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.162009 Dec 15 14:20:29.943279 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 723/1536] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:29 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:30.408507 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-12a6cc21-f2ee-442d-9e0e-0386aba2bcfd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:30.409258 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-12a6cc21-f2ee-442d-9e0e-0386aba2bcfd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:30.418774 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12a6cc21-f2ee-442d-9e0e-0386aba2bcfd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:30.419404 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12a6cc21-f2ee-442d-9e0e-0386aba2bcfd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:30.420529 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12a6cc21-f2ee-442d-9e0e-0386aba2bcfd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:30.421160 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12a6cc21-f2ee-442d-9e0e-0386aba2bcfd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:30.566422 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-12a6cc21-f2ee-442d-9e0e-0386aba2bcfd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:30.574941 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-12a6cc21-f2ee-442d-9e0e-0386aba2bcfd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.172693 Dec 15 14:20:30.575535 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 814/1537] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:30 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:30.852880 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-73862d51-ec72-4788-8a60-6c4a14f64ce4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:30.853461 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-73862d51-ec72-4788-8a60-6c4a14f64ce4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:30.860178 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73862d51-ec72-4788-8a60-6c4a14f64ce4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:30.860628 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73862d51-ec72-4788-8a60-6c4a14f64ce4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:30.861448 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73862d51-ec72-4788-8a60-6c4a14f64ce4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:30.861919 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73862d51-ec72-4788-8a60-6c4a14f64ce4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:30.960925 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7e595987-95ab-4361-b744-c79f5f3a02f1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:30.961495 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7e595987-95ab-4361-b744-c79f5f3a02f1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:30.968106 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e595987-95ab-4361-b744-c79f5f3a02f1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:30.968549 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e595987-95ab-4361-b744-c79f5f3a02f1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:30.969369 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e595987-95ab-4361-b744-c79f5f3a02f1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:30.969814 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e595987-95ab-4361-b744-c79f5f3a02f1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:31.055871 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-73862d51-ec72-4788-8a60-6c4a14f64ce4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:31.064225 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-73862d51-ec72-4788-8a60-6c4a14f64ce4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:31.065795 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-73862d51-ec72-4788-8a60-6c4a14f64ce4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:31.066914 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-73862d51-ec72-4788-8a60-6c4a14f64ce4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b" status: 200 len: 1408 microversion: 2.20 time: 0.217956 Dec 15 14:20:31.067490 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 724/1538] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:20:30 2021] GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:20:31.141091 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7e595987-95ab-4361-b744-c79f5f3a02f1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:31.149288 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7e595987-95ab-4361-b744-c79f5f3a02f1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.192199 Dec 15 14:20:31.149926 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 815/1539] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:30 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:31.592855 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6d51c166-491b-47c3-92a0-21109b5951e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:31.593485 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6d51c166-491b-47c3-92a0-21109b5951e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:31.600139 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d51c166-491b-47c3-92a0-21109b5951e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:31.600587 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d51c166-491b-47c3-92a0-21109b5951e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:31.601361 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d51c166-491b-47c3-92a0-21109b5951e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:31.601839 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d51c166-491b-47c3-92a0-21109b5951e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:31.745363 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6d51c166-491b-47c3-92a0-21109b5951e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:31.753598 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6d51c166-491b-47c3-92a0-21109b5951e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.164532 Dec 15 14:20:31.754198 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 725/1540] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:31 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:32.088762 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5b7f1472-7fea-4991-92a0-aeebd91a9bc6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:32.089719 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5b7f1472-7fea-4991-92a0-aeebd91a9bc6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:32.098555 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b7f1472-7fea-4991-92a0-aeebd91a9bc6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:32.098993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b7f1472-7fea-4991-92a0-aeebd91a9bc6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:32.099765 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b7f1472-7fea-4991-92a0-aeebd91a9bc6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:32.100191 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b7f1472-7fea-4991-92a0-aeebd91a9bc6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:32.169956 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5a0c431e-12a6-4697-bcfc-a92bdc0fb869 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:32.170527 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5a0c431e-12a6-4697-bcfc-a92bdc0fb869 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:32.177058 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a0c431e-12a6-4697-bcfc-a92bdc0fb869 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:32.177496 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a0c431e-12a6-4697-bcfc-a92bdc0fb869 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:32.178299 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a0c431e-12a6-4697-bcfc-a92bdc0fb869 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:32.178732 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a0c431e-12a6-4697-bcfc-a92bdc0fb869 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:32.265548 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5b7f1472-7fea-4991-92a0-aeebd91a9bc6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:32.276374 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5b7f1472-7fea-4991-92a0-aeebd91a9bc6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:32.278622 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5b7f1472-7fea-4991-92a0-aeebd91a9bc6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:32.280353 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5b7f1472-7fea-4991-92a0-aeebd91a9bc6 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b" status: 200 len: 1408 microversion: 2.20 time: 0.197558 Dec 15 14:20:32.281126 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 816/1541] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:20:32 2021] GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:20:32.341668 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5a0c431e-12a6-4697-bcfc-a92bdc0fb869 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:32.350660 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5a0c431e-12a6-4697-bcfc-a92bdc0fb869 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.184332 Dec 15 14:20:32.351259 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 726/1542] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:32 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:20:32.683010 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-bbd52eef-15c6-4f21-aa23-71b7a24fb8b4 req-af7bc586-df31-4b6a-abc4-e3987e46a320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52081f6-a4da-417f-8092-e26d5315a39b", "name": "network-vif-plugged", "status": "completed", "tag": "3be25b39-2c2c-49c8-8aae-df0e43911b97"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:32.685107 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:20:32.685107 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:20:32.692909 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-bbd52eef-15c6-4f21-aa23-71b7a24fb8b4 req-af7bc586-df31-4b6a-abc4-e3987e46a320 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:32.693267 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-bbd52eef-15c6-4f21-aa23-71b7a24fb8b4 req-af7bc586-df31-4b6a-abc4-e3987e46a320 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:32.705651 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-bbd52eef-15c6-4f21-aa23-71b7a24fb8b4 req-af7bc586-df31-4b6a-abc4-e3987e46a320 service nova] Creating event network-vif-plugged:3be25b39-2c2c-49c8-8aae-df0e43911b97 for instance a52081f6-a4da-417f-8092-e26d5315a39b on hv-cinder-82182 Dec 15 14:20:32.713667 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-bbd52eef-15c6-4f21-aa23-71b7a24fb8b4 req-af7bc586-df31-4b6a-abc4-e3987e46a320 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034085 Dec 15 14:20:32.714443 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 817/1543] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:20:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:20:32.776958 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-66710f93-696e-4d7b-9777-d865339386eb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:32.777816 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-66710f93-696e-4d7b-9777-d865339386eb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:32.785640 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66710f93-696e-4d7b-9777-d865339386eb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:32.786119 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66710f93-696e-4d7b-9777-d865339386eb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:32.786899 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66710f93-696e-4d7b-9777-d865339386eb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:32.787371 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66710f93-696e-4d7b-9777-d865339386eb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:32.953481 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-66710f93-696e-4d7b-9777-d865339386eb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:32.962609 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-66710f93-696e-4d7b-9777-d865339386eb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.190389 Dec 15 14:20:32.963190 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 727/1544] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:32 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:33.303585 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6b8ae3a1-682f-4a18-8707-f7053b59b308 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:33.304194 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6b8ae3a1-682f-4a18-8707-f7053b59b308 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:33.310839 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6b8ae3a1-682f-4a18-8707-f7053b59b308 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:33.311296 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6b8ae3a1-682f-4a18-8707-f7053b59b308 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:33.312088 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6b8ae3a1-682f-4a18-8707-f7053b59b308 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:33.312529 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6b8ae3a1-682f-4a18-8707-f7053b59b308 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:33.367841 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-af95cc22-dc6b-40e6-b6bd-e00efba382e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:33.368478 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-af95cc22-dc6b-40e6-b6bd-e00efba382e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:33.375848 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af95cc22-dc6b-40e6-b6bd-e00efba382e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:33.376105 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af95cc22-dc6b-40e6-b6bd-e00efba382e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:33.376891 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af95cc22-dc6b-40e6-b6bd-e00efba382e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:33.377351 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af95cc22-dc6b-40e6-b6bd-e00efba382e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:33.546449 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6b8ae3a1-682f-4a18-8707-f7053b59b308 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:33.555112 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6b8ae3a1-682f-4a18-8707-f7053b59b308 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:33.556523 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6b8ae3a1-682f-4a18-8707-f7053b59b308 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:33.557641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6b8ae3a1-682f-4a18-8707-f7053b59b308 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b" status: 200 len: 1408 microversion: 2.20 time: 0.258889 Dec 15 14:20:33.558507 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 818/1545] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:20:33 2021] GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b => generated 1408 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:20:33.598257 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-af95cc22-dc6b-40e6-b6bd-e00efba382e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:33.606403 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-af95cc22-dc6b-40e6-b6bd-e00efba382e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.242260 Dec 15 14:20:33.606984 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 728/1546] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:33 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:33.981038 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-20a6f56b-6598-4457-85b6-98b65be6ae83 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:33.981727 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-20a6f56b-6598-4457-85b6-98b65be6ae83 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:33.991210 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20a6f56b-6598-4457-85b6-98b65be6ae83 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:33.991677 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20a6f56b-6598-4457-85b6-98b65be6ae83 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:33.993460 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20a6f56b-6598-4457-85b6-98b65be6ae83 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:33.993933 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20a6f56b-6598-4457-85b6-98b65be6ae83 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:34.223226 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-20a6f56b-6598-4457-85b6-98b65be6ae83 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:34.232096 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-20a6f56b-6598-4457-85b6-98b65be6ae83 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.254786 Dec 15 14:20:34.237994 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 819/1547] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:33 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:34.579216 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8ce17887-9fcd-44f2-90eb-d9641db34770 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:34.580039 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8ce17887-9fcd-44f2-90eb-d9641db34770 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:34.589659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ce17887-9fcd-44f2-90eb-d9641db34770 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:34.590301 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ce17887-9fcd-44f2-90eb-d9641db34770 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:34.591526 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ce17887-9fcd-44f2-90eb-d9641db34770 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:34.591954 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ce17887-9fcd-44f2-90eb-d9641db34770 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:34.623836 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2cfb72c3-ac2a-4f8c-81b5-6ee8cfc594d0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:34.624469 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2cfb72c3-ac2a-4f8c-81b5-6ee8cfc594d0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:34.631492 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cfb72c3-ac2a-4f8c-81b5-6ee8cfc594d0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:34.631934 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cfb72c3-ac2a-4f8c-81b5-6ee8cfc594d0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:34.632711 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cfb72c3-ac2a-4f8c-81b5-6ee8cfc594d0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:34.633140 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cfb72c3-ac2a-4f8c-81b5-6ee8cfc594d0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:34.783188 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8ce17887-9fcd-44f2-90eb-d9641db34770 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:34.791867 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8ce17887-9fcd-44f2-90eb-d9641db34770 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:34.793362 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8ce17887-9fcd-44f2-90eb-d9641db34770 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:34.794598 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8ce17887-9fcd-44f2-90eb-d9641db34770 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b" status: 200 len: 1599 microversion: 2.20 time: 0.221852 Dec 15 14:20:34.795214 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 729/1548] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:20:34 2021] GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:20:34.811927 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-77730f54-ed3b-4507-8396-f35d6e3f165a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:34.812421 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-77730f54-ed3b-4507-8396-f35d6e3f165a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:34.814678 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2cfb72c3-ac2a-4f8c-81b5-6ee8cfc594d0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:34.818827 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77730f54-ed3b-4507-8396-f35d6e3f165a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:34.819291 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77730f54-ed3b-4507-8396-f35d6e3f165a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:34.820111 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77730f54-ed3b-4507-8396-f35d6e3f165a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:34.820544 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77730f54-ed3b-4507-8396-f35d6e3f165a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:34.822870 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2cfb72c3-ac2a-4f8c-81b5-6ee8cfc594d0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.202795 Dec 15 14:20:34.823453 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 820/1549] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:34 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:34.916552 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-77730f54-ed3b-4507-8396-f35d6e3f165a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.108188 Dec 15 14:20:34.917128 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 730/1550] 10.222.0.42 () {60 vars in 1315 bytes} [Wed Dec 15 14:20:34 2021] GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:20:35.249873 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f1e76d8d-0374-4eb7-baf7-260663ccb193 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:35.250386 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f1e76d8d-0374-4eb7-baf7-260663ccb193 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:35.257396 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1e76d8d-0374-4eb7-baf7-260663ccb193 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:35.257876 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1e76d8d-0374-4eb7-baf7-260663ccb193 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:35.258667 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1e76d8d-0374-4eb7-baf7-260663ccb193 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:35.259098 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1e76d8d-0374-4eb7-baf7-260663ccb193 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:35.500248 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f1e76d8d-0374-4eb7-baf7-260663ccb193 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:35.508340 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f1e76d8d-0374-4eb7-baf7-260663ccb193 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.262480 Dec 15 14:20:35.508918 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 821/1551] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:35 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:35.840705 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-273b118d-2a26-4092-a14b-e17177d10737 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:35.841399 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-273b118d-2a26-4092-a14b-e17177d10737 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:35.847637 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-273b118d-2a26-4092-a14b-e17177d10737 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:35.848297 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-273b118d-2a26-4092-a14b-e17177d10737 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:35.849099 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-273b118d-2a26-4092-a14b-e17177d10737 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:35.849530 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-273b118d-2a26-4092-a14b-e17177d10737 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:36.045124 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-50eb0361-c1e1-4bf7-9ca3-0154a6361e2a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:36.047056 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-50eb0361-c1e1-4bf7-9ca3-0154a6361e2a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:36.053827 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-50eb0361-c1e1-4bf7-9ca3-0154a6361e2a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:36.054274 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-50eb0361-c1e1-4bf7-9ca3-0154a6361e2a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:36.055083 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-50eb0361-c1e1-4bf7-9ca3-0154a6361e2a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:36.055566 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-50eb0361-c1e1-4bf7-9ca3-0154a6361e2a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:36.075459 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-273b118d-2a26-4092-a14b-e17177d10737 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:36.083786 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-273b118d-2a26-4092-a14b-e17177d10737 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.247209 Dec 15 14:20:36.084689 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 731/1552] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:35 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:36.088880 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-d5b1c6b6-29b8-4815-9084-630d50feffb3 req-9d215cb8-b159-4516-8988-36cfe4c7188a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52081f6-a4da-417f-8092-e26d5315a39b", "tag": "3be25b39-2c2c-49c8-8aae-df0e43911b97"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:36.090862 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:20:36.090862 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:20:36.099376 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-d5b1c6b6-29b8-4815-9084-630d50feffb3 req-9d215cb8-b159-4516-8988-36cfe4c7188a service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:36.099815 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-d5b1c6b6-29b8-4815-9084-630d50feffb3 req-9d215cb8-b159-4516-8988-36cfe4c7188a service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:36.110949 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-d5b1c6b6-29b8-4815-9084-630d50feffb3 req-9d215cb8-b159-4516-8988-36cfe4c7188a service nova] Creating event network-changed:3be25b39-2c2c-49c8-8aae-df0e43911b97 for instance a52081f6-a4da-417f-8092-e26d5315a39b on hv-cinder-82182 Dec 15 14:20:36.116136 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-d5b1c6b6-29b8-4815-9084-630d50feffb3 req-9d215cb8-b159-4516-8988-36cfe4c7188a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030456 Dec 15 14:20:36.116784 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 732/1553] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:20:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:20:36.160494 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-50eb0361-c1e1-4bf7-9ca3-0154a6361e2a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 14 microversion: 2.20 time: 0.118775 Dec 15 14:20:36.164068 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 822/1554] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:36 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:36.529179 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-07f2d1e0-7e71-43a9-b14f-0910358f7ddd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:36.530368 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-07f2d1e0-7e71-43a9-b14f-0910358f7ddd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:36.537831 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-07f2d1e0-7e71-43a9-b14f-0910358f7ddd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:36.538358 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-07f2d1e0-7e71-43a9-b14f-0910358f7ddd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:36.539234 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-07f2d1e0-7e71-43a9-b14f-0910358f7ddd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:36.539763 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-07f2d1e0-7e71-43a9-b14f-0910358f7ddd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:36.763653 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-07f2d1e0-7e71-43a9-b14f-0910358f7ddd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:36.775147 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-07f2d1e0-7e71-43a9-b14f-0910358f7ddd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.251853 Dec 15 14:20:36.775983 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 733/1555] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:36 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:37.102664 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9bff88c4-2cd7-4360-8c61-07ee01068928 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:37.103469 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9bff88c4-2cd7-4360-8c61-07ee01068928 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:37.110996 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9bff88c4-2cd7-4360-8c61-07ee01068928 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:37.111539 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9bff88c4-2cd7-4360-8c61-07ee01068928 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:37.112305 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9bff88c4-2cd7-4360-8c61-07ee01068928 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:37.112803 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9bff88c4-2cd7-4360-8c61-07ee01068928 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:37.172672 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6fb96ad4-6318-4349-a4fb-b64d859be587 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:37.173938 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6fb96ad4-6318-4349-a4fb-b64d859be587 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:37.180381 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fb96ad4-6318-4349-a4fb-b64d859be587 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:37.180906 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fb96ad4-6318-4349-a4fb-b64d859be587 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:37.181945 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fb96ad4-6318-4349-a4fb-b64d859be587 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:37.182367 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fb96ad4-6318-4349-a4fb-b64d859be587 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:37.258249 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6fb96ad4-6318-4349-a4fb-b64d859be587 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 14 microversion: 2.20 time: 0.089759 Dec 15 14:20:37.259059 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 734/1556] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:37 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:37.260433 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9bff88c4-2cd7-4360-8c61-07ee01068928 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:37.269317 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9bff88c4-2cd7-4360-8c61-07ee01068928 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.170715 Dec 15 14:20:37.269968 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 823/1557] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:37 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:37.794443 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c6509520-6de9-4e14-a528-780ce9961a12 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:37.795140 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c6509520-6de9-4e14-a528-780ce9961a12 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:37.802829 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6509520-6de9-4e14-a528-780ce9961a12 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:37.803280 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6509520-6de9-4e14-a528-780ce9961a12 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:37.804059 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6509520-6de9-4e14-a528-780ce9961a12 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:37.804521 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6509520-6de9-4e14-a528-780ce9961a12 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:37.957965 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c6509520-6de9-4e14-a528-780ce9961a12 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:37.971287 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c6509520-6de9-4e14-a528-780ce9961a12 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.180736 Dec 15 14:20:37.972155 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 735/1558] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:37 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:38.271826 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c43de295-1cf9-445c-90d8-9fedc4d82a6c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:38.272898 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c43de295-1cf9-445c-90d8-9fedc4d82a6c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:38.280654 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c43de295-1cf9-445c-90d8-9fedc4d82a6c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:38.281157 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c43de295-1cf9-445c-90d8-9fedc4d82a6c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:38.282065 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c43de295-1cf9-445c-90d8-9fedc4d82a6c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:38.282548 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c43de295-1cf9-445c-90d8-9fedc4d82a6c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:38.287511 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-70bcbe32-df3c-4e5c-b844-a5265b04fb4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:38.288198 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-70bcbe32-df3c-4e5c-b844-a5265b04fb4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:38.295362 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70bcbe32-df3c-4e5c-b844-a5265b04fb4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:38.295847 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70bcbe32-df3c-4e5c-b844-a5265b04fb4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:38.296706 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70bcbe32-df3c-4e5c-b844-a5265b04fb4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:38.297188 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70bcbe32-df3c-4e5c-b844-a5265b04fb4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:38.357992 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c43de295-1cf9-445c-90d8-9fedc4d82a6c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 14 microversion: 2.20 time: 0.091437 Dec 15 14:20:38.359372 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 824/1559] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:38 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:38.438244 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-70bcbe32-df3c-4e5c-b844-a5265b04fb4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:38.450898 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-70bcbe32-df3c-4e5c-b844-a5265b04fb4a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.167466 Dec 15 14:20:38.451489 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 736/1560] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:38 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:38.998310 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d6d1b650-35f7-4e8c-9704-cbe9d2b54d1d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:38.999509 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d6d1b650-35f7-4e8c-9704-cbe9d2b54d1d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:39.011338 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d6d1b650-35f7-4e8c-9704-cbe9d2b54d1d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:39.012047 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d6d1b650-35f7-4e8c-9704-cbe9d2b54d1d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:39.013341 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d6d1b650-35f7-4e8c-9704-cbe9d2b54d1d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:39.014297 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d6d1b650-35f7-4e8c-9704-cbe9d2b54d1d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:39.160331 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d6d1b650-35f7-4e8c-9704-cbe9d2b54d1d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:39.169149 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d6d1b650-35f7-4e8c-9704-cbe9d2b54d1d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.177854 Dec 15 14:20:39.169778 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 825/1561] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:38 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:39.372760 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c74a9a89-81a6-41ca-9002-446af41dfb96 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:39.374208 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c74a9a89-81a6-41ca-9002-446af41dfb96 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:39.382799 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c74a9a89-81a6-41ca-9002-446af41dfb96 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:39.383185 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c74a9a89-81a6-41ca-9002-446af41dfb96 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:39.383906 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c74a9a89-81a6-41ca-9002-446af41dfb96 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:39.384332 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c74a9a89-81a6-41ca-9002-446af41dfb96 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:39.463562 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c74a9a89-81a6-41ca-9002-446af41dfb96 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 14 microversion: 2.20 time: 0.097011 Dec 15 14:20:39.464135 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 737/1562] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:39 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:39.469507 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d934d5b0-6e6c-49ec-a8b7-54cce4f793a7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:39.470215 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d934d5b0-6e6c-49ec-a8b7-54cce4f793a7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:39.477853 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d934d5b0-6e6c-49ec-a8b7-54cce4f793a7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:39.478308 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d934d5b0-6e6c-49ec-a8b7-54cce4f793a7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:39.479101 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d934d5b0-6e6c-49ec-a8b7-54cce4f793a7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:39.479541 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d934d5b0-6e6c-49ec-a8b7-54cce4f793a7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:39.619052 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d934d5b0-6e6c-49ec-a8b7-54cce4f793a7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:39.627553 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d934d5b0-6e6c-49ec-a8b7-54cce4f793a7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.162210 Dec 15 14:20:39.628054 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 826/1563] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:39 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:40.191732 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d4bc7d46-0816-4b2d-87b8-8795f02086c7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:40.192437 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d4bc7d46-0816-4b2d-87b8-8795f02086c7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:40.199905 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4bc7d46-0816-4b2d-87b8-8795f02086c7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:40.200344 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4bc7d46-0816-4b2d-87b8-8795f02086c7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:40.201124 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4bc7d46-0816-4b2d-87b8-8795f02086c7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:40.201557 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4bc7d46-0816-4b2d-87b8-8795f02086c7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:40.356877 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d4bc7d46-0816-4b2d-87b8-8795f02086c7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:40.364942 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d4bc7d46-0816-4b2d-87b8-8795f02086c7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.179896 Dec 15 14:20:40.365503 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 738/1564] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:40 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:40.475324 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3d002f7c-49fc-4f8e-9d35-0055e9e4eeff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:40.476159 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3d002f7c-49fc-4f8e-9d35-0055e9e4eeff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:40.483404 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d002f7c-49fc-4f8e-9d35-0055e9e4eeff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:40.483856 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d002f7c-49fc-4f8e-9d35-0055e9e4eeff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:40.484645 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d002f7c-49fc-4f8e-9d35-0055e9e4eeff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:40.485082 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d002f7c-49fc-4f8e-9d35-0055e9e4eeff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:40.565113 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3d002f7c-49fc-4f8e-9d35-0055e9e4eeff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 14 microversion: 2.20 time: 0.093541 Dec 15 14:20:40.566820 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 827/1565] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:40 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:40.654444 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-45aed82d-c0f8-480c-916a-5a13ae0895c5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:40.658000 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-45aed82d-c0f8-480c-916a-5a13ae0895c5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:40.668109 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-45aed82d-c0f8-480c-916a-5a13ae0895c5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:40.668593 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-45aed82d-c0f8-480c-916a-5a13ae0895c5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:40.669330 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-45aed82d-c0f8-480c-916a-5a13ae0895c5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:40.669795 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-45aed82d-c0f8-480c-916a-5a13ae0895c5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:40.813454 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-45aed82d-c0f8-480c-916a-5a13ae0895c5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:40.822142 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-45aed82d-c0f8-480c-916a-5a13ae0895c5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.174730 Dec 15 14:20:40.822724 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 739/1566] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:40 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:41.388906 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-87842240-7ec5-499a-afcf-10bcc67cb419 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:41.389596 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-87842240-7ec5-499a-afcf-10bcc67cb419 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:41.396662 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87842240-7ec5-499a-afcf-10bcc67cb419 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:41.397100 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87842240-7ec5-499a-afcf-10bcc67cb419 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:41.397900 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87842240-7ec5-499a-afcf-10bcc67cb419 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:41.398339 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87842240-7ec5-499a-afcf-10bcc67cb419 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:41.536756 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-87842240-7ec5-499a-afcf-10bcc67cb419 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:41.545405 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-87842240-7ec5-499a-afcf-10bcc67cb419 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.160543 Dec 15 14:20:41.545979 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 828/1567] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:41 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:41.577931 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6db6ffa4-9205-45b3-962b-8629dab963e5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:41.579213 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6db6ffa4-9205-45b3-962b-8629dab963e5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:41.586204 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6db6ffa4-9205-45b3-962b-8629dab963e5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:41.586655 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6db6ffa4-9205-45b3-962b-8629dab963e5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:41.587444 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6db6ffa4-9205-45b3-962b-8629dab963e5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:41.587885 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6db6ffa4-9205-45b3-962b-8629dab963e5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:41.664134 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6db6ffa4-9205-45b3-962b-8629dab963e5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 14 microversion: 2.20 time: 0.089563 Dec 15 14:20:41.664952 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 740/1568] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:41 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:41.841147 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-34d3bff6-43b1-4a3f-8200-453fdbbc6c3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:41.841806 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-34d3bff6-43b1-4a3f-8200-453fdbbc6c3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:41.848495 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34d3bff6-43b1-4a3f-8200-453fdbbc6c3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:41.848952 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34d3bff6-43b1-4a3f-8200-453fdbbc6c3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:41.849796 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34d3bff6-43b1-4a3f-8200-453fdbbc6c3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:41.850214 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34d3bff6-43b1-4a3f-8200-453fdbbc6c3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:42.003650 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-34d3bff6-43b1-4a3f-8200-453fdbbc6c3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:42.013826 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-34d3bff6-43b1-4a3f-8200-453fdbbc6c3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.176454 Dec 15 14:20:42.014711 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 829/1569] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:41 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:42.569269 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-901bc19c-f4da-4ed5-a16b-f02620706ffe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:42.570393 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-901bc19c-f4da-4ed5-a16b-f02620706ffe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:42.582439 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-901bc19c-f4da-4ed5-a16b-f02620706ffe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:42.582888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-901bc19c-f4da-4ed5-a16b-f02620706ffe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:42.583683 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-901bc19c-f4da-4ed5-a16b-f02620706ffe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:42.584127 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-901bc19c-f4da-4ed5-a16b-f02620706ffe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:42.676808 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f9893e4e-37fb-4796-8030-58b06bd417fa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:42.677809 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f9893e4e-37fb-4796-8030-58b06bd417fa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:42.684841 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f9893e4e-37fb-4796-8030-58b06bd417fa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:42.685294 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f9893e4e-37fb-4796-8030-58b06bd417fa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:42.686215 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f9893e4e-37fb-4796-8030-58b06bd417fa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:42.686655 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f9893e4e-37fb-4796-8030-58b06bd417fa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:42.722646 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-901bc19c-f4da-4ed5-a16b-f02620706ffe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:42.730544 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-901bc19c-f4da-4ed5-a16b-f02620706ffe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.169330 Dec 15 14:20:42.731081 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 741/1570] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:42 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:42.762355 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f9893e4e-37fb-4796-8030-58b06bd417fa tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 14 microversion: 2.20 time: 0.089190 Dec 15 14:20:42.763048 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 830/1571] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:42 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:43.035845 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dd9e8abf-db5d-42a9-9f4b-6057aaeacf42 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:43.036419 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dd9e8abf-db5d-42a9-9f4b-6057aaeacf42 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:43.043092 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd9e8abf-db5d-42a9-9f4b-6057aaeacf42 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:43.043535 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd9e8abf-db5d-42a9-9f4b-6057aaeacf42 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:43.044294 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd9e8abf-db5d-42a9-9f4b-6057aaeacf42 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:43.044731 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd9e8abf-db5d-42a9-9f4b-6057aaeacf42 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:43.194065 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dd9e8abf-db5d-42a9-9f4b-6057aaeacf42 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:43.206088 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dd9e8abf-db5d-42a9-9f4b-6057aaeacf42 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.175782 Dec 15 14:20:43.206943 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 742/1572] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:43 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:43.753668 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f63c427e-9ae9-483b-97d6-3100eae49aa8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:43.758072 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f63c427e-9ae9-483b-97d6-3100eae49aa8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:43.772904 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f63c427e-9ae9-483b-97d6-3100eae49aa8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:43.773393 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f63c427e-9ae9-483b-97d6-3100eae49aa8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:43.774415 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f63c427e-9ae9-483b-97d6-3100eae49aa8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:43.774878 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f63c427e-9ae9-483b-97d6-3100eae49aa8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:43.775634 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dd8ee351-3222-441b-8cd4-6a020baf21be tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:43.780546 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dd8ee351-3222-441b-8cd4-6a020baf21be tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:43.789301 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd8ee351-3222-441b-8cd4-6a020baf21be tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:43.789775 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd8ee351-3222-441b-8cd4-6a020baf21be tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:43.790553 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd8ee351-3222-441b-8cd4-6a020baf21be tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:43.790981 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd8ee351-3222-441b-8cd4-6a020baf21be tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:43.874570 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dd8ee351-3222-441b-8cd4-6a020baf21be tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 14 microversion: 2.20 time: 0.102931 Dec 15 14:20:43.875217 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 743/1573] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:43 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:43.915617 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f63c427e-9ae9-483b-97d6-3100eae49aa8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:43.923701 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f63c427e-9ae9-483b-97d6-3100eae49aa8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.178300 Dec 15 14:20:43.924288 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 831/1574] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:43 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:44.232492 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8939a931-2cf7-4659-8c02-d2ac6872f4fb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:44.233349 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8939a931-2cf7-4659-8c02-d2ac6872f4fb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:44.242658 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8939a931-2cf7-4659-8c02-d2ac6872f4fb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:44.243242 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8939a931-2cf7-4659-8c02-d2ac6872f4fb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:44.244216 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8939a931-2cf7-4659-8c02-d2ac6872f4fb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:44.244759 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8939a931-2cf7-4659-8c02-d2ac6872f4fb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:44.402965 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8939a931-2cf7-4659-8c02-d2ac6872f4fb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:44.411038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8939a931-2cf7-4659-8c02-d2ac6872f4fb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.183609 Dec 15 14:20:44.411666 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 744/1575] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:44 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:44.886718 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2e6a6cbd-fa40-4f6d-8004-190acabdfd00 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:44.887641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2e6a6cbd-fa40-4f6d-8004-190acabdfd00 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:44.894747 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2e6a6cbd-fa40-4f6d-8004-190acabdfd00 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:44.895193 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2e6a6cbd-fa40-4f6d-8004-190acabdfd00 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:44.895976 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2e6a6cbd-fa40-4f6d-8004-190acabdfd00 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:44.896455 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2e6a6cbd-fa40-4f6d-8004-190acabdfd00 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:44.940432 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9a4a5bc4-79d4-4c1d-998e-c16028807578 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:44.941039 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9a4a5bc4-79d4-4c1d-998e-c16028807578 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:44.947948 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a4a5bc4-79d4-4c1d-998e-c16028807578 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:44.948402 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a4a5bc4-79d4-4c1d-998e-c16028807578 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:44.949191 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a4a5bc4-79d4-4c1d-998e-c16028807578 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:44.949603 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a4a5bc4-79d4-4c1d-998e-c16028807578 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:44.977810 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2e6a6cbd-fa40-4f6d-8004-190acabdfd00 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 14 microversion: 2.20 time: 0.094695 Dec 15 14:20:44.978487 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 832/1576] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:44 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:45.094447 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9a4a5bc4-79d4-4c1d-998e-c16028807578 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:45.106833 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9a4a5bc4-79d4-4c1d-998e-c16028807578 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.169847 Dec 15 14:20:45.107688 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 745/1577] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:44 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:45.430388 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-89728216-1122-4d8f-a534-50b289c13dba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:45.431074 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-89728216-1122-4d8f-a534-50b289c13dba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:45.438361 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-89728216-1122-4d8f-a534-50b289c13dba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:45.438805 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-89728216-1122-4d8f-a534-50b289c13dba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:45.439721 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-89728216-1122-4d8f-a534-50b289c13dba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:45.440148 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-89728216-1122-4d8f-a534-50b289c13dba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:45.585198 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-89728216-1122-4d8f-a534-50b289c13dba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:45.592932 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-89728216-1122-4d8f-a534-50b289c13dba tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.167206 Dec 15 14:20:45.593526 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 833/1578] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:45 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:45.992066 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3da07158-92b5-4001-bb4a-67d46dd91378 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:45.993154 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3da07158-92b5-4001-bb4a-67d46dd91378 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:46.000641 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3da07158-92b5-4001-bb4a-67d46dd91378 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:46.001133 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3da07158-92b5-4001-bb4a-67d46dd91378 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:46.002045 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3da07158-92b5-4001-bb4a-67d46dd91378 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:46.002516 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3da07158-92b5-4001-bb4a-67d46dd91378 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:46.079570 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3da07158-92b5-4001-bb4a-67d46dd91378 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 14 microversion: 2.20 time: 0.093147 Dec 15 14:20:46.080192 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 746/1579] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:45 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:46.127922 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c8d73e78-248c-4797-a1d3-711510d6b710 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:46.128504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c8d73e78-248c-4797-a1d3-711510d6b710 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:46.138269 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c8d73e78-248c-4797-a1d3-711510d6b710 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:46.138923 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c8d73e78-248c-4797-a1d3-711510d6b710 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:46.140010 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c8d73e78-248c-4797-a1d3-711510d6b710 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:46.140634 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c8d73e78-248c-4797-a1d3-711510d6b710 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:46.281888 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c8d73e78-248c-4797-a1d3-711510d6b710 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:46.289966 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c8d73e78-248c-4797-a1d3-711510d6b710 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.168167 Dec 15 14:20:46.290533 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 834/1580] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:46 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:46.614697 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ac32a75c-5cb7-4945-9e09-89975bd0a385 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:46.616093 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ac32a75c-5cb7-4945-9e09-89975bd0a385 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:46.623671 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac32a75c-5cb7-4945-9e09-89975bd0a385 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:46.624124 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac32a75c-5cb7-4945-9e09-89975bd0a385 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:46.624907 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac32a75c-5cb7-4945-9e09-89975bd0a385 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:46.625340 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac32a75c-5cb7-4945-9e09-89975bd0a385 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:46.772397 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ac32a75c-5cb7-4945-9e09-89975bd0a385 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:46.780550 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ac32a75c-5cb7-4945-9e09-89975bd0a385 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.172717 Dec 15 14:20:46.781154 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 747/1581] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:46 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:47.091665 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-44d06b4e-63e9-43c5-8613-44906189d185 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:47.092563 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-44d06b4e-63e9-43c5-8613-44906189d185 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:47.099795 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44d06b4e-63e9-43c5-8613-44906189d185 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:47.100260 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44d06b4e-63e9-43c5-8613-44906189d185 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:47.101089 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44d06b4e-63e9-43c5-8613-44906189d185 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:47.101595 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44d06b4e-63e9-43c5-8613-44906189d185 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:47.181733 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-44d06b4e-63e9-43c5-8613-44906189d185 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 11371 microversion: 2.20 time: 0.093550 Dec 15 14:20:47.182562 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 835/1582] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:47 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 11371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:20:47.308296 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a3b0c8a7-0e1d-456f-b4ac-7e74efcf455d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:47.308989 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a3b0c8a7-0e1d-456f-b4ac-7e74efcf455d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:47.317044 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3b0c8a7-0e1d-456f-b4ac-7e74efcf455d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:47.317588 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3b0c8a7-0e1d-456f-b4ac-7e74efcf455d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:47.318615 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3b0c8a7-0e1d-456f-b4ac-7e74efcf455d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:47.319090 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3b0c8a7-0e1d-456f-b4ac-7e74efcf455d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:47.459934 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a3b0c8a7-0e1d-456f-b4ac-7e74efcf455d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:47.468464 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a3b0c8a7-0e1d-456f-b4ac-7e74efcf455d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.164715 Dec 15 14:20:47.469044 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 748/1583] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:47 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:47.798813 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-44cb2598-de14-4f63-be6b-4a4a8bfc3d99 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:47.799535 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-44cb2598-de14-4f63-be6b-4a4a8bfc3d99 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:47.807157 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44cb2598-de14-4f63-be6b-4a4a8bfc3d99 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:47.807602 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44cb2598-de14-4f63-be6b-4a4a8bfc3d99 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:47.808371 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44cb2598-de14-4f63-be6b-4a4a8bfc3d99 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:47.808820 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44cb2598-de14-4f63-be6b-4a4a8bfc3d99 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:47.969564 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-44cb2598-de14-4f63-be6b-4a4a8bfc3d99 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:47.977783 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-44cb2598-de14-4f63-be6b-4a4a8bfc3d99 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.183095 Dec 15 14:20:47.978369 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 836/1584] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:47 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:48.196372 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-37d7dd2d-8c58-4178-95fc-ad0335b0c0df tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:48.197684 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-37d7dd2d-8c58-4178-95fc-ad0335b0c0df tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:48.207583 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-37d7dd2d-8c58-4178-95fc-ad0335b0c0df tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:48.208181 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-37d7dd2d-8c58-4178-95fc-ad0335b0c0df tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:48.209228 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-37d7dd2d-8c58-4178-95fc-ad0335b0c0df tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:48.209669 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-37d7dd2d-8c58-4178-95fc-ad0335b0c0df tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:48.299671 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-37d7dd2d-8c58-4178-95fc-ad0335b0c0df tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 18561 microversion: 2.20 time: 0.108209 Dec 15 14:20:48.300680 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 749/1585] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:48 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 18561 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:20:48.486808 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4f0f2b4d-6db3-42bc-af4c-a171ca9b755d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:48.487402 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4f0f2b4d-6db3-42bc-af4c-a171ca9b755d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:48.494445 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4f0f2b4d-6db3-42bc-af4c-a171ca9b755d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:48.494895 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4f0f2b4d-6db3-42bc-af4c-a171ca9b755d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:48.495687 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4f0f2b4d-6db3-42bc-af4c-a171ca9b755d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:48.496117 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4f0f2b4d-6db3-42bc-af4c-a171ca9b755d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:48.647232 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4f0f2b4d-6db3-42bc-af4c-a171ca9b755d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:48.655794 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4f0f2b4d-6db3-42bc-af4c-a171ca9b755d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.173044 Dec 15 14:20:48.656366 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 837/1586] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:48 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:49.003374 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2393b304-5500-4a96-a4c8-e9679aa7051a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:49.004534 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2393b304-5500-4a96-a4c8-e9679aa7051a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:49.016510 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2393b304-5500-4a96-a4c8-e9679aa7051a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:49.017302 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2393b304-5500-4a96-a4c8-e9679aa7051a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:49.018660 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2393b304-5500-4a96-a4c8-e9679aa7051a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:49.019434 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2393b304-5500-4a96-a4c8-e9679aa7051a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:49.168183 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2393b304-5500-4a96-a4c8-e9679aa7051a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:49.176392 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2393b304-5500-4a96-a4c8-e9679aa7051a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.179747 Dec 15 14:20:49.176964 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 750/1587] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:48 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:20:49.316929 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1cee834b-9024-48f5-9b06-94886779dd49 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:49.318559 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1cee834b-9024-48f5-9b06-94886779dd49 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:49.325475 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1cee834b-9024-48f5-9b06-94886779dd49 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:49.325964 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1cee834b-9024-48f5-9b06-94886779dd49 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:49.326754 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1cee834b-9024-48f5-9b06-94886779dd49 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:49.327194 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1cee834b-9024-48f5-9b06-94886779dd49 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:49.411648 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1cee834b-9024-48f5-9b06-94886779dd49 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 19133 microversion: 2.20 time: 0.101016 Dec 15 14:20:49.412384 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 838/1588] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:49 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 19133 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:20:49.677994 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-82949d80-5c33-4206-a7dd-5a932cb868e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:49.678609 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-82949d80-5c33-4206-a7dd-5a932cb868e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:49.685779 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-82949d80-5c33-4206-a7dd-5a932cb868e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:49.686248 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-82949d80-5c33-4206-a7dd-5a932cb868e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:49.687075 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-82949d80-5c33-4206-a7dd-5a932cb868e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:49.687533 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-82949d80-5c33-4206-a7dd-5a932cb868e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:49.832006 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-82949d80-5c33-4206-a7dd-5a932cb868e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:49.841305 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-82949d80-5c33-4206-a7dd-5a932cb868e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.169971 Dec 15 14:20:49.841933 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 751/1589] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:49 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:50.194724 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7339faa4-8c00-4ed4-86c3-aed434bc9786 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:50.195381 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7339faa4-8c00-4ed4-86c3-aed434bc9786 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:50.202954 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7339faa4-8c00-4ed4-86c3-aed434bc9786 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:50.203743 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7339faa4-8c00-4ed4-86c3-aed434bc9786 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:50.204530 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7339faa4-8c00-4ed4-86c3-aed434bc9786 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:50.204961 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7339faa4-8c00-4ed4-86c3-aed434bc9786 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:50.366923 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7339faa4-8c00-4ed4-86c3-aed434bc9786 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:50.374343 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7339faa4-8c00-4ed4-86c3-aed434bc9786 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.183943 Dec 15 14:20:50.374909 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 839/1590] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:50 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:50.423985 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-96374cfc-71d3-4e69-ab60-30ac92c24cb2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:50.424946 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-96374cfc-71d3-4e69-ab60-30ac92c24cb2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:50.432272 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96374cfc-71d3-4e69-ab60-30ac92c24cb2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:50.432723 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96374cfc-71d3-4e69-ab60-30ac92c24cb2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:50.433506 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96374cfc-71d3-4e69-ab60-30ac92c24cb2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:50.434183 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96374cfc-71d3-4e69-ab60-30ac92c24cb2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:50.515556 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-96374cfc-71d3-4e69-ab60-30ac92c24cb2 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 21790 microversion: 2.20 time: 0.095079 Dec 15 14:20:50.516116 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 752/1591] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:50 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 21790 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:20:50.862110 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-88e393f5-5b28-4af2-b525-a1a793760df6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:50.863049 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-88e393f5-5b28-4af2-b525-a1a793760df6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:50.874192 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-88e393f5-5b28-4af2-b525-a1a793760df6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:50.874885 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-88e393f5-5b28-4af2-b525-a1a793760df6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:50.876076 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-88e393f5-5b28-4af2-b525-a1a793760df6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:50.876740 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-88e393f5-5b28-4af2-b525-a1a793760df6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:51.018855 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-88e393f5-5b28-4af2-b525-a1a793760df6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:51.027571 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-88e393f5-5b28-4af2-b525-a1a793760df6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.171465 Dec 15 14:20:51.028172 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 840/1592] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:50 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:51.396378 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5fe4d041-5524-4d3e-9dfc-be4af0b32e33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:51.398060 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5fe4d041-5524-4d3e-9dfc-be4af0b32e33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:51.405303 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fe4d041-5524-4d3e-9dfc-be4af0b32e33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:51.405778 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fe4d041-5524-4d3e-9dfc-be4af0b32e33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:51.406562 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fe4d041-5524-4d3e-9dfc-be4af0b32e33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:51.407000 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fe4d041-5524-4d3e-9dfc-be4af0b32e33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:51.526807 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e47a5d63-d51d-4f12-b246-221bd7b607cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:51.528015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e47a5d63-d51d-4f12-b246-221bd7b607cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:51.534664 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e47a5d63-d51d-4f12-b246-221bd7b607cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:51.535113 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e47a5d63-d51d-4f12-b246-221bd7b607cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:51.535904 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e47a5d63-d51d-4f12-b246-221bd7b607cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:51.536341 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e47a5d63-d51d-4f12-b246-221bd7b607cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:51.546497 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5fe4d041-5524-4d3e-9dfc-be4af0b32e33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:51.554456 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5fe4d041-5524-4d3e-9dfc-be4af0b32e33 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.164662 Dec 15 14:20:51.555289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 753/1593] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:51 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:51.621453 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e47a5d63-d51d-4f12-b246-221bd7b607cf tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 23235 microversion: 2.20 time: 0.098337 Dec 15 14:20:51.622125 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 841/1594] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:51 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 23235 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:20:52.050051 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-487a3c89-5aa2-4a97-abed-33bedb79e532 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:52.051223 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-487a3c89-5aa2-4a97-abed-33bedb79e532 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:52.059904 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-487a3c89-5aa2-4a97-abed-33bedb79e532 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:52.060363 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-487a3c89-5aa2-4a97-abed-33bedb79e532 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:52.061198 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-487a3c89-5aa2-4a97-abed-33bedb79e532 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:52.061644 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-487a3c89-5aa2-4a97-abed-33bedb79e532 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:52.211210 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-487a3c89-5aa2-4a97-abed-33bedb79e532 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:52.219523 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-487a3c89-5aa2-4a97-abed-33bedb79e532 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.175891 Dec 15 14:20:52.220107 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 754/1595] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:52 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:52.576595 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-349f243f-5ea7-4402-85bb-75c488b19a83 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:52.577260 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-349f243f-5ea7-4402-85bb-75c488b19a83 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:52.588136 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-349f243f-5ea7-4402-85bb-75c488b19a83 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:52.588576 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-349f243f-5ea7-4402-85bb-75c488b19a83 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:52.589360 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-349f243f-5ea7-4402-85bb-75c488b19a83 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:52.589827 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-349f243f-5ea7-4402-85bb-75c488b19a83 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:52.632510 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b8ca41ae-a460-4f4f-bfaa-582dd1bde02f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:52.633419 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b8ca41ae-a460-4f4f-bfaa-582dd1bde02f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:52.640067 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8ca41ae-a460-4f4f-bfaa-582dd1bde02f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:52.640521 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8ca41ae-a460-4f4f-bfaa-582dd1bde02f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:52.641349 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8ca41ae-a460-4f4f-bfaa-582dd1bde02f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:52.641822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8ca41ae-a460-4f4f-bfaa-582dd1bde02f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:52.719320 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b8ca41ae-a460-4f4f-bfaa-582dd1bde02f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 24581 microversion: 2.20 time: 0.090370 Dec 15 14:20:52.720328 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 755/1596] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:52 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 24581 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:20:52.734607 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-349f243f-5ea7-4402-85bb-75c488b19a83 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:52.742647 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-349f243f-5ea7-4402-85bb-75c488b19a83 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.172448 Dec 15 14:20:52.743521 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 842/1597] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:52 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:53.244013 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c0129411-bb85-4f72-b598-ce1f7d1ba7ad tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:53.244716 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c0129411-bb85-4f72-b598-ce1f7d1ba7ad tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:53.252137 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0129411-bb85-4f72-b598-ce1f7d1ba7ad tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:53.252559 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0129411-bb85-4f72-b598-ce1f7d1ba7ad tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:53.253333 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0129411-bb85-4f72-b598-ce1f7d1ba7ad tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:53.253797 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0129411-bb85-4f72-b598-ce1f7d1ba7ad tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:53.395425 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c0129411-bb85-4f72-b598-ce1f7d1ba7ad tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:53.403664 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c0129411-bb85-4f72-b598-ce1f7d1ba7ad tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.166132 Dec 15 14:20:53.404256 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 756/1598] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:53 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:53.733028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5790c7b2-d759-45ec-bb20-194af78beee9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:53.734100 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5790c7b2-d759-45ec-bb20-194af78beee9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:53.741552 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5790c7b2-d759-45ec-bb20-194af78beee9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:53.742067 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5790c7b2-d759-45ec-bb20-194af78beee9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:53.742954 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5790c7b2-d759-45ec-bb20-194af78beee9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:53.743437 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5790c7b2-d759-45ec-bb20-194af78beee9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:53.760792 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3899b952-32d8-4082-97d2-abae8b0cd45b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:53.761537 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3899b952-32d8-4082-97d2-abae8b0cd45b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:53.768014 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3899b952-32d8-4082-97d2-abae8b0cd45b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:53.768464 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3899b952-32d8-4082-97d2-abae8b0cd45b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:53.769259 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3899b952-32d8-4082-97d2-abae8b0cd45b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:53.769728 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3899b952-32d8-4082-97d2-abae8b0cd45b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:53.824482 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5790c7b2-d759-45ec-bb20-194af78beee9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 26202 microversion: 2.20 time: 0.095736 Dec 15 14:20:53.825264 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 843/1599] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:53 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 26202 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:20:53.921532 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3899b952-32d8-4082-97d2-abae8b0cd45b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:53.929749 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3899b952-32d8-4082-97d2-abae8b0cd45b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.173182 Dec 15 14:20:53.930322 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 757/1600] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:53 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:54.426793 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ef7ea1bd-2ff7-447d-b0d5-dd51e5d6dbdc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:54.427954 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ef7ea1bd-2ff7-447d-b0d5-dd51e5d6dbdc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:54.439739 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef7ea1bd-2ff7-447d-b0d5-dd51e5d6dbdc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:54.440489 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef7ea1bd-2ff7-447d-b0d5-dd51e5d6dbdc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:54.442136 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef7ea1bd-2ff7-447d-b0d5-dd51e5d6dbdc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:54.442868 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef7ea1bd-2ff7-447d-b0d5-dd51e5d6dbdc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:54.618005 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ef7ea1bd-2ff7-447d-b0d5-dd51e5d6dbdc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:54.630348 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ef7ea1bd-2ff7-447d-b0d5-dd51e5d6dbdc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.210174 Dec 15 14:20:54.631126 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 844/1601] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:54 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:54.837355 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6a6b642b-1220-43d4-a29d-738f76134198 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:54.838271 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6a6b642b-1220-43d4-a29d-738f76134198 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:54.845346 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6a6b642b-1220-43d4-a29d-738f76134198 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:54.845848 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6a6b642b-1220-43d4-a29d-738f76134198 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:54.846607 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6a6b642b-1220-43d4-a29d-738f76134198 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:54.847036 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6a6b642b-1220-43d4-a29d-738f76134198 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:54.929631 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6a6b642b-1220-43d4-a29d-738f76134198 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 27399 microversion: 2.20 time: 0.095947 Dec 15 14:20:54.930257 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 758/1602] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:54 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 27399 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:20:54.947340 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2b29c84c-b9dc-4004-b014-55bd2a467d68 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:54.947992 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2b29c84c-b9dc-4004-b014-55bd2a467d68 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:54.955261 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b29c84c-b9dc-4004-b014-55bd2a467d68 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:54.955707 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b29c84c-b9dc-4004-b014-55bd2a467d68 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:54.956491 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b29c84c-b9dc-4004-b014-55bd2a467d68 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:54.956919 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b29c84c-b9dc-4004-b014-55bd2a467d68 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:55.337945 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2b29c84c-b9dc-4004-b014-55bd2a467d68 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:55.348161 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2b29c84c-b9dc-4004-b014-55bd2a467d68 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.404583 Dec 15 14:20:55.348737 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 845/1603] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:54 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:55.652543 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-55765f1e-1354-4eed-8b38-06d4ba92fa2b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:55.653274 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-55765f1e-1354-4eed-8b38-06d4ba92fa2b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:55.661196 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55765f1e-1354-4eed-8b38-06d4ba92fa2b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:55.661737 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55765f1e-1354-4eed-8b38-06d4ba92fa2b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:55.662589 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55765f1e-1354-4eed-8b38-06d4ba92fa2b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:55.663064 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55765f1e-1354-4eed-8b38-06d4ba92fa2b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:55.813333 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-55765f1e-1354-4eed-8b38-06d4ba92fa2b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:55.824388 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-55765f1e-1354-4eed-8b38-06d4ba92fa2b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.177765 Dec 15 14:20:55.825116 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 759/1604] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:55 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:55.945112 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2d7bf0ef-b11a-4e42-b5fc-a1611c7d6ab8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:55.946453 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2d7bf0ef-b11a-4e42-b5fc-a1611c7d6ab8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:55.954199 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d7bf0ef-b11a-4e42-b5fc-a1611c7d6ab8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:55.954851 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d7bf0ef-b11a-4e42-b5fc-a1611c7d6ab8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:55.955429 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d7bf0ef-b11a-4e42-b5fc-a1611c7d6ab8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:55.955865 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d7bf0ef-b11a-4e42-b5fc-a1611c7d6ab8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:56.040263 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2d7bf0ef-b11a-4e42-b5fc-a1611c7d6ab8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 27785 microversion: 2.20 time: 0.100883 Dec 15 14:20:56.041017 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 846/1605] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:55 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 27785 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:20:56.367930 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e3f421d8-a4e3-448a-aef4-4e2456225930 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:56.368542 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e3f421d8-a4e3-448a-aef4-4e2456225930 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:56.375594 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e3f421d8-a4e3-448a-aef4-4e2456225930 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:56.376038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e3f421d8-a4e3-448a-aef4-4e2456225930 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:56.376838 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e3f421d8-a4e3-448a-aef4-4e2456225930 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:56.377264 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e3f421d8-a4e3-448a-aef4-4e2456225930 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:56.526517 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e3f421d8-a4e3-448a-aef4-4e2456225930 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:56.536379 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e3f421d8-a4e3-448a-aef4-4e2456225930 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.171906 Dec 15 14:20:56.537184 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 760/1606] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:56 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:56.846375 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-03f5f058-c72b-4419-a5b8-283594a3059b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:56.847071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-03f5f058-c72b-4419-a5b8-283594a3059b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:56.854662 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03f5f058-c72b-4419-a5b8-283594a3059b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:56.855110 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03f5f058-c72b-4419-a5b8-283594a3059b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:56.855920 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03f5f058-c72b-4419-a5b8-283594a3059b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:56.856321 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03f5f058-c72b-4419-a5b8-283594a3059b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:56.994359 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-03f5f058-c72b-4419-a5b8-283594a3059b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:57.003092 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-03f5f058-c72b-4419-a5b8-283594a3059b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.161024 Dec 15 14:20:57.003667 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 847/1607] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:56 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:57.055432 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7836f35b-0ea7-4ce0-9165-1a420df6106b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:57.056605 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7836f35b-0ea7-4ce0-9165-1a420df6106b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:57.062998 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7836f35b-0ea7-4ce0-9165-1a420df6106b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:57.063448 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7836f35b-0ea7-4ce0-9165-1a420df6106b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:57.064228 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7836f35b-0ea7-4ce0-9165-1a420df6106b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:57.064658 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7836f35b-0ea7-4ce0-9165-1a420df6106b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:57.149142 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7836f35b-0ea7-4ce0-9165-1a420df6106b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28164 microversion: 2.20 time: 0.098516 Dec 15 14:20:57.149800 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 761/1608] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:57 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28164 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:20:57.561310 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cefc56e2-7a1c-4f4b-b97a-1e648ea30827 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:57.562222 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cefc56e2-7a1c-4f4b-b97a-1e648ea30827 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:57.572482 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cefc56e2-7a1c-4f4b-b97a-1e648ea30827 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:57.573504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cefc56e2-7a1c-4f4b-b97a-1e648ea30827 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:57.574054 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cefc56e2-7a1c-4f4b-b97a-1e648ea30827 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:57.574489 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cefc56e2-7a1c-4f4b-b97a-1e648ea30827 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:57.726132 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cefc56e2-7a1c-4f4b-b97a-1e648ea30827 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:57.737664 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cefc56e2-7a1c-4f4b-b97a-1e648ea30827 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.181949 Dec 15 14:20:57.738471 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 848/1609] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:57 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:58.025120 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d7a561b9-4ebc-45ea-b093-c17ab6f69f95 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:58.026378 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d7a561b9-4ebc-45ea-b093-c17ab6f69f95 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:58.034271 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7a561b9-4ebc-45ea-b093-c17ab6f69f95 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:58.034590 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7a561b9-4ebc-45ea-b093-c17ab6f69f95 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:58.035385 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7a561b9-4ebc-45ea-b093-c17ab6f69f95 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:58.035824 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7a561b9-4ebc-45ea-b093-c17ab6f69f95 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:58.161017 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-41113dcd-5d2a-4448-af8d-6b4635d26cd3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:58.161990 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-41113dcd-5d2a-4448-af8d-6b4635d26cd3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:58.169028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41113dcd-5d2a-4448-af8d-6b4635d26cd3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:58.169766 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41113dcd-5d2a-4448-af8d-6b4635d26cd3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:58.170567 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41113dcd-5d2a-4448-af8d-6b4635d26cd3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:58.171035 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41113dcd-5d2a-4448-af8d-6b4635d26cd3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:58.177595 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d7a561b9-4ebc-45ea-b093-c17ab6f69f95 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:58.187542 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d7a561b9-4ebc-45ea-b093-c17ab6f69f95 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.168971 Dec 15 14:20:58.188500 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 762/1610] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:58 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:58.260342 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-41113dcd-5d2a-4448-af8d-6b4635d26cd3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28164 microversion: 2.20 time: 0.103201 Dec 15 14:20:58.260995 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 849/1611] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:58 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28164 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:20:58.762293 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5d13e877-6874-40c4-becb-2c65cea361fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:58.763308 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5d13e877-6874-40c4-becb-2c65cea361fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:58.773751 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d13e877-6874-40c4-becb-2c65cea361fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:58.774492 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d13e877-6874-40c4-becb-2c65cea361fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:58.775776 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d13e877-6874-40c4-becb-2c65cea361fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:58.776501 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d13e877-6874-40c4-becb-2c65cea361fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:58.924833 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5d13e877-6874-40c4-becb-2c65cea361fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:58.937279 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5d13e877-6874-40c4-becb-2c65cea361fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.181284 Dec 15 14:20:58.938082 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 763/1612] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:58 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:59.210499 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cbabf1c1-a262-47e0-b166-99dcd5daf6ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:59.211641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cbabf1c1-a262-47e0-b166-99dcd5daf6ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:59.219907 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cbabf1c1-a262-47e0-b166-99dcd5daf6ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:59.220361 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cbabf1c1-a262-47e0-b166-99dcd5daf6ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:59.221142 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cbabf1c1-a262-47e0-b166-99dcd5daf6ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:59.221579 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cbabf1c1-a262-47e0-b166-99dcd5daf6ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:59.272266 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-596df320-29cc-4827-ae65-c725ee928195 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:59.273364 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-596df320-29cc-4827-ae65-c725ee928195 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:59.279919 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-596df320-29cc-4827-ae65-c725ee928195 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:59.280448 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-596df320-29cc-4827-ae65-c725ee928195 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:59.281268 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-596df320-29cc-4827-ae65-c725ee928195 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:59.281833 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-596df320-29cc-4827-ae65-c725ee928195 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:59.370621 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cbabf1c1-a262-47e0-b166-99dcd5daf6ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:59.375279 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-596df320-29cc-4827-ae65-c725ee928195 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28164 microversion: 2.20 time: 0.106599 Dec 15 14:20:59.375933 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 764/1613] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:20:59 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28164 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:20:59.379122 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cbabf1c1-a262-47e0-b166-99dcd5daf6ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.175799 Dec 15 14:20:59.379697 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 850/1614] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:59 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:59.963756 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1fb41436-5ad8-4bb2-9f44-11f6856d2c5f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:59.965071 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1fb41436-5ad8-4bb2-9f44-11f6856d2c5f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:59.972644 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1fb41436-5ad8-4bb2-9f44-11f6856d2c5f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:59.973092 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1fb41436-5ad8-4bb2-9f44-11f6856d2c5f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:59.973936 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1fb41436-5ad8-4bb2-9f44-11f6856d2c5f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:59.974383 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1fb41436-5ad8-4bb2-9f44-11f6856d2c5f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:00.124167 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1fb41436-5ad8-4bb2-9f44-11f6856d2c5f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:00.136564 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1fb41436-5ad8-4bb2-9f44-11f6856d2c5f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.179522 Dec 15 14:21:00.137377 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 765/1615] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:59 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:00.389106 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d09ac868-f033-440c-ad44-46fe35658213 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:00.390073 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d09ac868-f033-440c-ad44-46fe35658213 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:00.396051 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0e9ae452-cf6e-45e9-a5f4-37d0e78e865d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:00.396662 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0e9ae452-cf6e-45e9-a5f4-37d0e78e865d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:00.397156 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d09ac868-f033-440c-ad44-46fe35658213 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:00.397631 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d09ac868-f033-440c-ad44-46fe35658213 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:00.398442 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d09ac868-f033-440c-ad44-46fe35658213 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:00.398879 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d09ac868-f033-440c-ad44-46fe35658213 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:00.403934 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e9ae452-cf6e-45e9-a5f4-37d0e78e865d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:00.404378 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e9ae452-cf6e-45e9-a5f4-37d0e78e865d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:00.405160 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e9ae452-cf6e-45e9-a5f4-37d0e78e865d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:00.405599 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e9ae452-cf6e-45e9-a5f4-37d0e78e865d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:00.483571 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d09ac868-f033-440c-ad44-46fe35658213 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28164 microversion: 2.20 time: 0.098852 Dec 15 14:21:00.487774 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 851/1616] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:00 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28164 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:00.562636 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0e9ae452-cf6e-45e9-a5f4-37d0e78e865d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:00.575721 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0e9ae452-cf6e-45e9-a5f4-37d0e78e865d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.183338 Dec 15 14:21:00.576331 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 766/1617] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:00 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:01.164107 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-786bba70-21df-4b10-b5af-9d09741cb132 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:01.165072 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-786bba70-21df-4b10-b5af-9d09741cb132 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:01.173575 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-786bba70-21df-4b10-b5af-9d09741cb132 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:01.174073 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-786bba70-21df-4b10-b5af-9d09741cb132 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:01.174886 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-786bba70-21df-4b10-b5af-9d09741cb132 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:01.175336 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-786bba70-21df-4b10-b5af-9d09741cb132 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:01.330557 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-786bba70-21df-4b10-b5af-9d09741cb132 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:01.341469 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-786bba70-21df-4b10-b5af-9d09741cb132 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.183799 Dec 15 14:21:01.342110 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 852/1618] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:01 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:01.499316 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a58f83c1-53e0-47b2-819c-f7868cbae3b1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:01.502351 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a58f83c1-53e0-47b2-819c-f7868cbae3b1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:01.510414 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a58f83c1-53e0-47b2-819c-f7868cbae3b1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:01.510860 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a58f83c1-53e0-47b2-819c-f7868cbae3b1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:01.511814 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a58f83c1-53e0-47b2-819c-f7868cbae3b1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:01.512339 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a58f83c1-53e0-47b2-819c-f7868cbae3b1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:01.594366 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ef4d67df-9120-4d3d-8624-ef11c99417b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:01.595413 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ef4d67df-9120-4d3d-8624-ef11c99417b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:01.599572 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a58f83c1-53e0-47b2-819c-f7868cbae3b1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28164 microversion: 2.20 time: 0.105824 Dec 15 14:21:01.604232 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 767/1619] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:01 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28164 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:01.604423 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef4d67df-9120-4d3d-8624-ef11c99417b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:01.604423 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef4d67df-9120-4d3d-8624-ef11c99417b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:01.604423 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef4d67df-9120-4d3d-8624-ef11c99417b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:01.605226 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef4d67df-9120-4d3d-8624-ef11c99417b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:01.770760 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ef4d67df-9120-4d3d-8624-ef11c99417b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:01.779815 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ef4d67df-9120-4d3d-8624-ef11c99417b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.189549 Dec 15 14:21:01.780433 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 853/1620] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:01 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:02.366424 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-38a8b447-b5b8-41e9-914b-5b8738f19350 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:02.367153 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-38a8b447-b5b8-41e9-914b-5b8738f19350 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:02.376493 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38a8b447-b5b8-41e9-914b-5b8738f19350 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:02.377967 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38a8b447-b5b8-41e9-914b-5b8738f19350 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:02.378843 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38a8b447-b5b8-41e9-914b-5b8738f19350 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:02.379562 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38a8b447-b5b8-41e9-914b-5b8738f19350 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:02.560522 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-38a8b447-b5b8-41e9-914b-5b8738f19350 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:02.570804 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-38a8b447-b5b8-41e9-914b-5b8738f19350 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.214883 Dec 15 14:21:02.571869 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 768/1621] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:02 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:02.612608 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6b7794aa-cda8-48dd-b7f6-1dc1892a57d3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:02.613583 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6b7794aa-cda8-48dd-b7f6-1dc1892a57d3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:02.620451 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6b7794aa-cda8-48dd-b7f6-1dc1892a57d3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:02.620932 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6b7794aa-cda8-48dd-b7f6-1dc1892a57d3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:02.621807 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6b7794aa-cda8-48dd-b7f6-1dc1892a57d3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:02.622270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6b7794aa-cda8-48dd-b7f6-1dc1892a57d3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:02.700313 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6b7794aa-cda8-48dd-b7f6-1dc1892a57d3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28164 microversion: 2.20 time: 0.091318 Dec 15 14:21:02.701009 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 854/1622] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:02 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28164 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:02.801877 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8341b45d-7378-4486-a5b8-ffa4e456e5c4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:02.802969 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8341b45d-7378-4486-a5b8-ffa4e456e5c4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:02.814064 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8341b45d-7378-4486-a5b8-ffa4e456e5c4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:02.814831 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8341b45d-7378-4486-a5b8-ffa4e456e5c4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:02.816226 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8341b45d-7378-4486-a5b8-ffa4e456e5c4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:02.816984 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8341b45d-7378-4486-a5b8-ffa4e456e5c4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:02.958436 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8341b45d-7378-4486-a5b8-ffa4e456e5c4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:02.966714 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8341b45d-7378-4486-a5b8-ffa4e456e5c4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.171468 Dec 15 14:21:02.967331 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 769/1623] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:02 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:03.598541 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fa851587-dc2c-484c-a0cc-7785f295e977 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:03.599294 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fa851587-dc2c-484c-a0cc-7785f295e977 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:03.607745 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa851587-dc2c-484c-a0cc-7785f295e977 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:03.608199 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa851587-dc2c-484c-a0cc-7785f295e977 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:03.609007 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa851587-dc2c-484c-a0cc-7785f295e977 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:03.609445 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa851587-dc2c-484c-a0cc-7785f295e977 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:03.712622 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-52e7c9fe-bc77-4e22-99a2-adc10b41a5a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:03.713634 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-52e7c9fe-bc77-4e22-99a2-adc10b41a5a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:03.720396 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-52e7c9fe-bc77-4e22-99a2-adc10b41a5a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:03.720997 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-52e7c9fe-bc77-4e22-99a2-adc10b41a5a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:03.721979 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-52e7c9fe-bc77-4e22-99a2-adc10b41a5a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:03.722413 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-52e7c9fe-bc77-4e22-99a2-adc10b41a5a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:03.758713 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fa851587-dc2c-484c-a0cc-7785f295e977 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:03.766762 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fa851587-dc2c-484c-a0cc-7785f295e977 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.174736 Dec 15 14:21:03.767361 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 855/1624] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:03 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:03.801671 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-52e7c9fe-bc77-4e22-99a2-adc10b41a5a8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28164 microversion: 2.20 time: 0.092756 Dec 15 14:21:03.802344 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 770/1625] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:03 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28164 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:21:03.985631 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-358e0aa7-1282-4674-905a-fde4031242c4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:03.986150 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-358e0aa7-1282-4674-905a-fde4031242c4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:03.993291 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-358e0aa7-1282-4674-905a-fde4031242c4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:03.993738 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-358e0aa7-1282-4674-905a-fde4031242c4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:03.994542 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-358e0aa7-1282-4674-905a-fde4031242c4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:03.994971 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-358e0aa7-1282-4674-905a-fde4031242c4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:04.164890 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-358e0aa7-1282-4674-905a-fde4031242c4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:04.174733 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-358e0aa7-1282-4674-905a-fde4031242c4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.193780 Dec 15 14:21:04.175307 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 856/1626] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:03 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:04.785234 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-16264a23-7fca-49ee-a940-b85c44d4c8a7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:04.785957 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-16264a23-7fca-49ee-a940-b85c44d4c8a7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:04.793480 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16264a23-7fca-49ee-a940-b85c44d4c8a7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:04.793950 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16264a23-7fca-49ee-a940-b85c44d4c8a7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:04.795073 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16264a23-7fca-49ee-a940-b85c44d4c8a7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:04.795905 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16264a23-7fca-49ee-a940-b85c44d4c8a7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:04.814266 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f65a9dea-bc04-4e24-903e-fa0e666f1ded tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:04.815197 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f65a9dea-bc04-4e24-903e-fa0e666f1ded tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:04.822071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f65a9dea-bc04-4e24-903e-fa0e666f1ded tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:04.822520 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f65a9dea-bc04-4e24-903e-fa0e666f1ded tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:04.823360 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f65a9dea-bc04-4e24-903e-fa0e666f1ded tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:04.823801 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f65a9dea-bc04-4e24-903e-fa0e666f1ded tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:04.901154 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f65a9dea-bc04-4e24-903e-fa0e666f1ded tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28164 microversion: 2.20 time: 0.090661 Dec 15 14:21:04.902222 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 857/1627] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:04 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28164 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:04.960208 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-16264a23-7fca-49ee-a940-b85c44d4c8a7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:04.968013 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-16264a23-7fca-49ee-a940-b85c44d4c8a7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.186969 Dec 15 14:21:04.968583 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 771/1628] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:04 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:05.199333 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2588da19-f7e0-45ca-9d73-6a942a0f693d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:05.200173 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2588da19-f7e0-45ca-9d73-6a942a0f693d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:05.209837 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2588da19-f7e0-45ca-9d73-6a942a0f693d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:05.210465 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2588da19-f7e0-45ca-9d73-6a942a0f693d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:05.211620 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2588da19-f7e0-45ca-9d73-6a942a0f693d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:05.212207 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2588da19-f7e0-45ca-9d73-6a942a0f693d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:05.369278 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2588da19-f7e0-45ca-9d73-6a942a0f693d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:05.379248 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2588da19-f7e0-45ca-9d73-6a942a0f693d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.186482 Dec 15 14:21:05.379823 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 858/1629] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:05 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:05.915814 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a843c1bf-c54b-4feb-ac94-42e8de7303ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:05.916638 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a843c1bf-c54b-4feb-ac94-42e8de7303ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:05.923763 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a843c1bf-c54b-4feb-ac94-42e8de7303ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:05.924189 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a843c1bf-c54b-4feb-ac94-42e8de7303ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:05.924975 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a843c1bf-c54b-4feb-ac94-42e8de7303ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:05.925411 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a843c1bf-c54b-4feb-ac94-42e8de7303ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:05.988703 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b0875d55-1b47-4d57-a002-d97d796e4d37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:05.989423 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b0875d55-1b47-4d57-a002-d97d796e4d37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:05.999144 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0875d55-1b47-4d57-a002-d97d796e4d37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:05.999585 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0875d55-1b47-4d57-a002-d97d796e4d37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:06.000377 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0875d55-1b47-4d57-a002-d97d796e4d37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:06.000812 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0875d55-1b47-4d57-a002-d97d796e4d37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:06.002251 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a843c1bf-c54b-4feb-ac94-42e8de7303ec tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28164 microversion: 2.20 time: 0.090187 Dec 15 14:21:06.002952 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 772/1630] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:05 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28164 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:06.154933 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b0875d55-1b47-4d57-a002-d97d796e4d37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:06.163202 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b0875d55-1b47-4d57-a002-d97d796e4d37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.180465 Dec 15 14:21:06.163771 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 859/1631] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:05 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:06.396990 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6e924aa3-5916-4def-9854-3e72cea9c7dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:06.397715 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6e924aa3-5916-4def-9854-3e72cea9c7dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:06.405224 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e924aa3-5916-4def-9854-3e72cea9c7dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:06.405701 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e924aa3-5916-4def-9854-3e72cea9c7dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:06.406614 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e924aa3-5916-4def-9854-3e72cea9c7dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:06.407054 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e924aa3-5916-4def-9854-3e72cea9c7dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:06.556170 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6e924aa3-5916-4def-9854-3e72cea9c7dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:06.566941 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6e924aa3-5916-4def-9854-3e72cea9c7dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.174034 Dec 15 14:21:06.567706 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 773/1632] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:06 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:07.015916 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2f657526-1716-4999-8be2-43e2c4b13771 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:07.016860 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2f657526-1716-4999-8be2-43e2c4b13771 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:07.024225 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f657526-1716-4999-8be2-43e2c4b13771 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:07.024680 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f657526-1716-4999-8be2-43e2c4b13771 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:07.025461 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f657526-1716-4999-8be2-43e2c4b13771 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:07.025932 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f657526-1716-4999-8be2-43e2c4b13771 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:07.107336 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2f657526-1716-4999-8be2-43e2c4b13771 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28164 microversion: 2.20 time: 0.095498 Dec 15 14:21:07.108412 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 860/1633] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:07 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28164 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:07.182323 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-da852a16-b73e-430f-a68c-9e014fd6f28a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:07.183209 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-da852a16-b73e-430f-a68c-9e014fd6f28a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:07.193784 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da852a16-b73e-430f-a68c-9e014fd6f28a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:07.194472 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da852a16-b73e-430f-a68c-9e014fd6f28a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:07.195652 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da852a16-b73e-430f-a68c-9e014fd6f28a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:07.196204 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da852a16-b73e-430f-a68c-9e014fd6f28a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:07.352000 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-da852a16-b73e-430f-a68c-9e014fd6f28a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:07.362601 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-da852a16-b73e-430f-a68c-9e014fd6f28a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.185016 Dec 15 14:21:07.363323 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 774/1634] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:07 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:07.592527 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cad28bbd-fc15-4536-bbf5-650ef57a9f79 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:07.593269 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cad28bbd-fc15-4536-bbf5-650ef57a9f79 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:07.601950 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cad28bbd-fc15-4536-bbf5-650ef57a9f79 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:07.602401 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cad28bbd-fc15-4536-bbf5-650ef57a9f79 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:07.603194 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cad28bbd-fc15-4536-bbf5-650ef57a9f79 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:07.603628 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cad28bbd-fc15-4536-bbf5-650ef57a9f79 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:07.761909 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cad28bbd-fc15-4536-bbf5-650ef57a9f79 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:07.770414 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cad28bbd-fc15-4536-bbf5-650ef57a9f79 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.184523 Dec 15 14:21:07.770992 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 861/1635] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:07 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:08.121960 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4d4b1590-39e8-4c24-85eb-9be9f9df9832 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:08.122897 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4d4b1590-39e8-4c24-85eb-9be9f9df9832 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:08.130565 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d4b1590-39e8-4c24-85eb-9be9f9df9832 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:08.131022 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d4b1590-39e8-4c24-85eb-9be9f9df9832 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:08.131835 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d4b1590-39e8-4c24-85eb-9be9f9df9832 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:08.132274 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d4b1590-39e8-4c24-85eb-9be9f9df9832 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:08.221458 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4d4b1590-39e8-4c24-85eb-9be9f9df9832 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28164 microversion: 2.20 time: 0.103417 Dec 15 14:21:08.222185 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 775/1636] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:08 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28164 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:08.380519 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-89efe881-045b-4ea9-92c1-884bd5de83ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:08.381103 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-89efe881-045b-4ea9-92c1-884bd5de83ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:08.388069 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-89efe881-045b-4ea9-92c1-884bd5de83ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:08.388539 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-89efe881-045b-4ea9-92c1-884bd5de83ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:08.389330 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-89efe881-045b-4ea9-92c1-884bd5de83ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:08.389795 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-89efe881-045b-4ea9-92c1-884bd5de83ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:08.529928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-89efe881-045b-4ea9-92c1-884bd5de83ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:08.537955 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-89efe881-045b-4ea9-92c1-884bd5de83ff tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.161351 Dec 15 14:21:08.538528 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 862/1637] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:08 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:08.788487 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ad73fcae-1615-4375-949c-cde440e4b67b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:08.789188 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ad73fcae-1615-4375-949c-cde440e4b67b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:08.796810 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad73fcae-1615-4375-949c-cde440e4b67b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:08.797262 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad73fcae-1615-4375-949c-cde440e4b67b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:08.798096 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad73fcae-1615-4375-949c-cde440e4b67b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:08.798540 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad73fcae-1615-4375-949c-cde440e4b67b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:08.937395 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ad73fcae-1615-4375-949c-cde440e4b67b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:08.945835 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ad73fcae-1615-4375-949c-cde440e4b67b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.161478 Dec 15 14:21:08.946407 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 776/1638] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:08 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:09.234127 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-496e594c-5e96-4749-b88b-7d2d67b1955f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:09.235090 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-496e594c-5e96-4749-b88b-7d2d67b1955f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:09.242163 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-496e594c-5e96-4749-b88b-7d2d67b1955f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:09.242628 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-496e594c-5e96-4749-b88b-7d2d67b1955f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:09.243429 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-496e594c-5e96-4749-b88b-7d2d67b1955f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:09.243870 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-496e594c-5e96-4749-b88b-7d2d67b1955f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:09.321148 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-496e594c-5e96-4749-b88b-7d2d67b1955f tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28164 microversion: 2.20 time: 0.091066 Dec 15 14:21:09.321838 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 863/1639] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:09 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28164 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:09.556137 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9a1d4af2-2ecb-4871-a088-397a35f78fa9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:09.556751 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9a1d4af2-2ecb-4871-a088-397a35f78fa9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:09.564188 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a1d4af2-2ecb-4871-a088-397a35f78fa9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:09.564783 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a1d4af2-2ecb-4871-a088-397a35f78fa9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:09.565595 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a1d4af2-2ecb-4871-a088-397a35f78fa9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:09.566205 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a1d4af2-2ecb-4871-a088-397a35f78fa9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:09.780085 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9a1d4af2-2ecb-4871-a088-397a35f78fa9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:09.789561 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9a1d4af2-2ecb-4871-a088-397a35f78fa9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.237335 Dec 15 14:21:09.790263 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 777/1640] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:09 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:09.968632 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ce77243b-763a-4cea-a2f2-7fc91258a021 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:09.969843 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ce77243b-763a-4cea-a2f2-7fc91258a021 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:09.981585 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce77243b-763a-4cea-a2f2-7fc91258a021 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:09.982486 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce77243b-763a-4cea-a2f2-7fc91258a021 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:09.983815 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce77243b-763a-4cea-a2f2-7fc91258a021 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:09.984703 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce77243b-763a-4cea-a2f2-7fc91258a021 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:10.192800 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ce77243b-763a-4cea-a2f2-7fc91258a021 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:10.207586 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ce77243b-763a-4cea-a2f2-7fc91258a021 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.246141 Dec 15 14:21:10.208589 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 864/1641] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:09 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:10.334209 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fd890d8e-1d6e-4bae-9c76-fdbe87d9444e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:10.335537 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fd890d8e-1d6e-4bae-9c76-fdbe87d9444e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:10.344760 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd890d8e-1d6e-4bae-9c76-fdbe87d9444e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:10.345207 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd890d8e-1d6e-4bae-9c76-fdbe87d9444e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:10.346075 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd890d8e-1d6e-4bae-9c76-fdbe87d9444e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:10.346514 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd890d8e-1d6e-4bae-9c76-fdbe87d9444e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:10.439529 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fd890d8e-1d6e-4bae-9c76-fdbe87d9444e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28455 microversion: 2.20 time: 0.109906 Dec 15 14:21:10.440043 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 778/1642] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:10 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:10.809592 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-422f26a8-f3a9-44bd-9ae6-3f2c01b88ebc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:10.810314 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-422f26a8-f3a9-44bd-9ae6-3f2c01b88ebc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:10.817162 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-422f26a8-f3a9-44bd-9ae6-3f2c01b88ebc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:10.818186 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-422f26a8-f3a9-44bd-9ae6-3f2c01b88ebc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:10.819130 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-422f26a8-f3a9-44bd-9ae6-3f2c01b88ebc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:10.820220 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-422f26a8-f3a9-44bd-9ae6-3f2c01b88ebc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:10.978790 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-422f26a8-f3a9-44bd-9ae6-3f2c01b88ebc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:10.987278 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-422f26a8-f3a9-44bd-9ae6-3f2c01b88ebc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.182447 Dec 15 14:21:10.987881 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 865/1643] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:10 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:11.234991 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1592a29a-6a6e-4b53-b058-61b740f262af tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:11.235652 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1592a29a-6a6e-4b53-b058-61b740f262af tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:11.243112 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1592a29a-6a6e-4b53-b058-61b740f262af tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:11.243565 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1592a29a-6a6e-4b53-b058-61b740f262af tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:11.244358 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1592a29a-6a6e-4b53-b058-61b740f262af tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:11.244799 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1592a29a-6a6e-4b53-b058-61b740f262af tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:11.386915 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1592a29a-6a6e-4b53-b058-61b740f262af tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:11.396074 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1592a29a-6a6e-4b53-b058-61b740f262af tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.165761 Dec 15 14:21:11.396940 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 779/1644] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:11 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:11.455322 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ca301844-fdf0-4395-9f38-1aaae95391f8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:11.456669 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ca301844-fdf0-4395-9f38-1aaae95391f8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:11.467082 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca301844-fdf0-4395-9f38-1aaae95391f8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:11.467532 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca301844-fdf0-4395-9f38-1aaae95391f8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:11.468307 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca301844-fdf0-4395-9f38-1aaae95391f8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:11.468732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca301844-fdf0-4395-9f38-1aaae95391f8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:11.555007 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ca301844-fdf0-4395-9f38-1aaae95391f8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28578 microversion: 2.20 time: 0.106337 Dec 15 14:21:11.555588 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 866/1645] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:11 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28578 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:12.006525 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ee85721b-6f76-4c9f-b36f-8cdc11398a2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:12.007135 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ee85721b-6f76-4c9f-b36f-8cdc11398a2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:12.016422 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee85721b-6f76-4c9f-b36f-8cdc11398a2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:12.016863 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee85721b-6f76-4c9f-b36f-8cdc11398a2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:12.017666 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee85721b-6f76-4c9f-b36f-8cdc11398a2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:12.018119 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee85721b-6f76-4c9f-b36f-8cdc11398a2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:12.212071 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ee85721b-6f76-4c9f-b36f-8cdc11398a2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:12.221255 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ee85721b-6f76-4c9f-b36f-8cdc11398a2f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.219727 Dec 15 14:21:12.221959 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 780/1646] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:12 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:12.414832 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b0eb3c8b-e408-4f2a-8767-2ceec6b7a7ba tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:12.415582 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b0eb3c8b-e408-4f2a-8767-2ceec6b7a7ba tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:12.428040 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0eb3c8b-e408-4f2a-8767-2ceec6b7a7ba tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:12.428487 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0eb3c8b-e408-4f2a-8767-2ceec6b7a7ba tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:12.429399 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0eb3c8b-e408-4f2a-8767-2ceec6b7a7ba tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:12.429917 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0eb3c8b-e408-4f2a-8767-2ceec6b7a7ba tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:12.568922 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8bcc0099-2ffa-4747-b0ff-7140972d1925 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:12.570000 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8bcc0099-2ffa-4747-b0ff-7140972d1925 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:12.577731 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8bcc0099-2ffa-4747-b0ff-7140972d1925 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:12.578818 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8bcc0099-2ffa-4747-b0ff-7140972d1925 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:12.579743 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8bcc0099-2ffa-4747-b0ff-7140972d1925 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:12.580259 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8bcc0099-2ffa-4747-b0ff-7140972d1925 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:12.585389 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b0eb3c8b-e408-4f2a-8767-2ceec6b7a7ba tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:12.596246 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b0eb3c8b-e408-4f2a-8767-2ceec6b7a7ba tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.185708 Dec 15 14:21:12.596812 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 867/1647] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:12 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:12.673221 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8bcc0099-2ffa-4747-b0ff-7140972d1925 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.107799 Dec 15 14:21:12.673676 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 781/1648] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:12 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:13.240509 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2acaaaf1-fca1-42cd-8bb4-c7d6dbfb8384 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:13.241121 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2acaaaf1-fca1-42cd-8bb4-c7d6dbfb8384 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:13.247928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2acaaaf1-fca1-42cd-8bb4-c7d6dbfb8384 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:13.248463 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2acaaaf1-fca1-42cd-8bb4-c7d6dbfb8384 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:13.249274 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2acaaaf1-fca1-42cd-8bb4-c7d6dbfb8384 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:13.249747 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2acaaaf1-fca1-42cd-8bb4-c7d6dbfb8384 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:13.387344 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2acaaaf1-fca1-42cd-8bb4-c7d6dbfb8384 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:13.395607 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2acaaaf1-fca1-42cd-8bb4-c7d6dbfb8384 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.159148 Dec 15 14:21:13.396143 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 868/1649] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:13 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:13.614551 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e434f81b-33d2-4e3a-8e80-9d11fc6a1b0c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:13.615232 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e434f81b-33d2-4e3a-8e80-9d11fc6a1b0c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:13.622971 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e434f81b-33d2-4e3a-8e80-9d11fc6a1b0c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:13.623603 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e434f81b-33d2-4e3a-8e80-9d11fc6a1b0c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:13.624400 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e434f81b-33d2-4e3a-8e80-9d11fc6a1b0c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:13.624841 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e434f81b-33d2-4e3a-8e80-9d11fc6a1b0c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:13.685152 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-31db0ac1-ea83-47b9-9020-50a45a01fd52 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:13.686468 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-31db0ac1-ea83-47b9-9020-50a45a01fd52 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:13.693663 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-31db0ac1-ea83-47b9-9020-50a45a01fd52 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:13.694121 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-31db0ac1-ea83-47b9-9020-50a45a01fd52 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:13.694959 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-31db0ac1-ea83-47b9-9020-50a45a01fd52 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:13.695395 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-31db0ac1-ea83-47b9-9020-50a45a01fd52 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:13.774389 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-31db0ac1-ea83-47b9-9020-50a45a01fd52 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.092839 Dec 15 14:21:13.775321 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 869/1650] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:13 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:21:13.779350 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e434f81b-33d2-4e3a-8e80-9d11fc6a1b0c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:13.787854 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e434f81b-33d2-4e3a-8e80-9d11fc6a1b0c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.177481 Dec 15 14:21:13.788441 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 782/1651] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:13 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:14.413939 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d756b7e2-0a50-4565-a510-fb40916eefdb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:14.414653 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d756b7e2-0a50-4565-a510-fb40916eefdb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:14.422428 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d756b7e2-0a50-4565-a510-fb40916eefdb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:14.422879 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d756b7e2-0a50-4565-a510-fb40916eefdb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:14.423671 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d756b7e2-0a50-4565-a510-fb40916eefdb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:14.424107 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d756b7e2-0a50-4565-a510-fb40916eefdb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:14.565990 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d756b7e2-0a50-4565-a510-fb40916eefdb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:14.573780 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d756b7e2-0a50-4565-a510-fb40916eefdb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.164012 Dec 15 14:21:14.574412 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 870/1652] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:14 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:14.786782 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-06f112ef-54ea-4956-b8b3-788280da4836 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:14.787729 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-06f112ef-54ea-4956-b8b3-788280da4836 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:14.794674 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06f112ef-54ea-4956-b8b3-788280da4836 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:14.795398 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06f112ef-54ea-4956-b8b3-788280da4836 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:14.796204 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06f112ef-54ea-4956-b8b3-788280da4836 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:14.796688 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06f112ef-54ea-4956-b8b3-788280da4836 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:14.806018 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2d95ff1f-ec91-4b5f-9e17-1fa5633a42d6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:14.806601 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2d95ff1f-ec91-4b5f-9e17-1fa5633a42d6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:14.813511 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d95ff1f-ec91-4b5f-9e17-1fa5633a42d6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:14.813989 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d95ff1f-ec91-4b5f-9e17-1fa5633a42d6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:14.814784 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d95ff1f-ec91-4b5f-9e17-1fa5633a42d6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:14.815212 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d95ff1f-ec91-4b5f-9e17-1fa5633a42d6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:14.878964 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-06f112ef-54ea-4956-b8b3-788280da4836 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.095895 Dec 15 14:21:14.879620 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 783/1653] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:14 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:14.960036 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2d95ff1f-ec91-4b5f-9e17-1fa5633a42d6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:14.969159 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2d95ff1f-ec91-4b5f-9e17-1fa5633a42d6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.166848 Dec 15 14:21:14.969761 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 871/1654] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:14 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:15.592949 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-afdbac7b-2412-4b2a-a0c1-189f337bf1ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:15.593643 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-afdbac7b-2412-4b2a-a0c1-189f337bf1ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:15.601243 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-afdbac7b-2412-4b2a-a0c1-189f337bf1ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:15.601725 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-afdbac7b-2412-4b2a-a0c1-189f337bf1ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:15.602515 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-afdbac7b-2412-4b2a-a0c1-189f337bf1ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:15.602955 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-afdbac7b-2412-4b2a-a0c1-189f337bf1ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:15.745474 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-afdbac7b-2412-4b2a-a0c1-189f337bf1ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:15.753779 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-afdbac7b-2412-4b2a-a0c1-189f337bf1ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.165154 Dec 15 14:21:15.754340 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 784/1655] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:15 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:15.891589 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-68da3407-5b7f-44d4-a3f6-99c2cd0587e3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:15.892544 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-68da3407-5b7f-44d4-a3f6-99c2cd0587e3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:15.899247 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68da3407-5b7f-44d4-a3f6-99c2cd0587e3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:15.899700 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68da3407-5b7f-44d4-a3f6-99c2cd0587e3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:15.900485 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68da3407-5b7f-44d4-a3f6-99c2cd0587e3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:15.900922 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68da3407-5b7f-44d4-a3f6-99c2cd0587e3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:15.986609 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f2aa9f31-edb3-41f2-9a12-d991d1dfa9e5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:15.987200 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f2aa9f31-edb3-41f2-9a12-d991d1dfa9e5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:15.993886 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f2aa9f31-edb3-41f2-9a12-d991d1dfa9e5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:15.994353 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f2aa9f31-edb3-41f2-9a12-d991d1dfa9e5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:15.995125 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f2aa9f31-edb3-41f2-9a12-d991d1dfa9e5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:15.995738 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f2aa9f31-edb3-41f2-9a12-d991d1dfa9e5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:16.006700 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-68da3407-5b7f-44d4-a3f6-99c2cd0587e3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.119272 Dec 15 14:21:16.007386 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 872/1656] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:15 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:16.136258 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f2aa9f31-edb3-41f2-9a12-d991d1dfa9e5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:16.145336 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f2aa9f31-edb3-41f2-9a12-d991d1dfa9e5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.162518 Dec 15 14:21:16.145982 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 785/1657] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:15 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:16.772214 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c0148baf-de63-4270-9c37-5480d7a5ea37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:16.772902 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c0148baf-de63-4270-9c37-5480d7a5ea37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:16.781375 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0148baf-de63-4270-9c37-5480d7a5ea37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:16.781924 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0148baf-de63-4270-9c37-5480d7a5ea37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:16.783175 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0148baf-de63-4270-9c37-5480d7a5ea37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:16.783692 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0148baf-de63-4270-9c37-5480d7a5ea37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:16.935258 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c0148baf-de63-4270-9c37-5480d7a5ea37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:16.943737 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c0148baf-de63-4270-9c37-5480d7a5ea37 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.176125 Dec 15 14:21:16.944312 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 873/1658] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:16 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:17.019278 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6b089b09-4402-45a7-98a4-397a5fa934c3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:17.020300 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6b089b09-4402-45a7-98a4-397a5fa934c3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:17.027262 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b089b09-4402-45a7-98a4-397a5fa934c3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:17.027637 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b089b09-4402-45a7-98a4-397a5fa934c3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:17.028423 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b089b09-4402-45a7-98a4-397a5fa934c3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:17.028846 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b089b09-4402-45a7-98a4-397a5fa934c3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:17.111686 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6b089b09-4402-45a7-98a4-397a5fa934c3 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.095879 Dec 15 14:21:17.112480 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 786/1659] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:17 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:17.163735 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3d425639-5c5b-484d-b649-ec599d1c74fa tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:17.164356 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3d425639-5c5b-484d-b649-ec599d1c74fa tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:17.171693 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d425639-5c5b-484d-b649-ec599d1c74fa tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:17.172152 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d425639-5c5b-484d-b649-ec599d1c74fa tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:17.172958 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d425639-5c5b-484d-b649-ec599d1c74fa tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:17.173377 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d425639-5c5b-484d-b649-ec599d1c74fa tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:17.320557 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3d425639-5c5b-484d-b649-ec599d1c74fa tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:17.329424 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3d425639-5c5b-484d-b649-ec599d1c74fa tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.169541 Dec 15 14:21:17.330030 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 874/1660] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:17 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:17.962915 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c5173b74-a424-4240-9ad6-a8e2097a235e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:17.963615 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c5173b74-a424-4240-9ad6-a8e2097a235e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:17.971255 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c5173b74-a424-4240-9ad6-a8e2097a235e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:17.971706 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c5173b74-a424-4240-9ad6-a8e2097a235e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:17.972504 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c5173b74-a424-4240-9ad6-a8e2097a235e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:17.972937 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c5173b74-a424-4240-9ad6-a8e2097a235e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:18.120233 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c5173b74-a424-4240-9ad6-a8e2097a235e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:18.124526 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f8a708c8-3981-4cd3-9a78-8673e9ce1926 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:18.125444 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f8a708c8-3981-4cd3-9a78-8673e9ce1926 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:18.128431 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c5173b74-a424-4240-9ad6-a8e2097a235e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.169647 Dec 15 14:21:18.129010 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 787/1661] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:17 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:18.132228 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f8a708c8-3981-4cd3-9a78-8673e9ce1926 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:18.132706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f8a708c8-3981-4cd3-9a78-8673e9ce1926 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:18.133783 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f8a708c8-3981-4cd3-9a78-8673e9ce1926 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:18.134176 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f8a708c8-3981-4cd3-9a78-8673e9ce1926 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:18.213560 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f8a708c8-3981-4cd3-9a78-8673e9ce1926 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.093040 Dec 15 14:21:18.214363 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 875/1662] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:18 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:18.347140 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1118c75d-6076-4fd1-9a51-b787efd20663 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:18.347760 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1118c75d-6076-4fd1-9a51-b787efd20663 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:18.354549 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1118c75d-6076-4fd1-9a51-b787efd20663 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:18.355014 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1118c75d-6076-4fd1-9a51-b787efd20663 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:18.355849 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1118c75d-6076-4fd1-9a51-b787efd20663 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:18.356289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1118c75d-6076-4fd1-9a51-b787efd20663 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:18.499192 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1118c75d-6076-4fd1-9a51-b787efd20663 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:18.507854 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1118c75d-6076-4fd1-9a51-b787efd20663 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.164678 Dec 15 14:21:18.508458 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 788/1663] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:18 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:19.147066 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-34070ad0-74cc-4f03-b24a-f1e6bdf3fc4e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:19.147844 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-34070ad0-74cc-4f03-b24a-f1e6bdf3fc4e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:19.155482 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34070ad0-74cc-4f03-b24a-f1e6bdf3fc4e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:19.155928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34070ad0-74cc-4f03-b24a-f1e6bdf3fc4e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:19.156722 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34070ad0-74cc-4f03-b24a-f1e6bdf3fc4e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:19.157175 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34070ad0-74cc-4f03-b24a-f1e6bdf3fc4e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:19.225920 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-831862e2-bf9b-4e46-8637-43c652b6a3de tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:19.226844 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-831862e2-bf9b-4e46-8637-43c652b6a3de tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:19.236159 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-831862e2-bf9b-4e46-8637-43c652b6a3de tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:19.236601 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-831862e2-bf9b-4e46-8637-43c652b6a3de tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:19.237394 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-831862e2-bf9b-4e46-8637-43c652b6a3de tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:19.237850 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-831862e2-bf9b-4e46-8637-43c652b6a3de tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:19.303400 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-34070ad0-74cc-4f03-b24a-f1e6bdf3fc4e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:19.311883 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-34070ad0-74cc-4f03-b24a-f1e6bdf3fc4e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.169451 Dec 15 14:21:19.312480 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 876/1664] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:19 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:19.317035 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-831862e2-bf9b-4e46-8637-43c652b6a3de tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.094743 Dec 15 14:21:19.317704 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 789/1665] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:19 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:19.526125 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a59d53c0-3ff8-443d-bbbd-e80f12d8be74 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:19.526752 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a59d53c0-3ff8-443d-bbbd-e80f12d8be74 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:19.533806 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a59d53c0-3ff8-443d-bbbd-e80f12d8be74 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:19.534240 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a59d53c0-3ff8-443d-bbbd-e80f12d8be74 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:19.535034 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a59d53c0-3ff8-443d-bbbd-e80f12d8be74 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:19.535470 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a59d53c0-3ff8-443d-bbbd-e80f12d8be74 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:19.671726 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a59d53c0-3ff8-443d-bbbd-e80f12d8be74 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:19.680209 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a59d53c0-3ff8-443d-bbbd-e80f12d8be74 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.157922 Dec 15 14:21:19.680794 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 877/1666] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:19 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:20.329468 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bc7bfeea-a1c7-4eb5-806d-159fc607dd9b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:20.330202 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c0b10582-e6b1-4ee8-8188-efa95d94c2e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:20.330603 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c0b10582-e6b1-4ee8-8188-efa95d94c2e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:20.330709 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bc7bfeea-a1c7-4eb5-806d-159fc607dd9b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:20.337283 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bc7bfeea-a1c7-4eb5-806d-159fc607dd9b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:20.337641 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0b10582-e6b1-4ee8-8188-efa95d94c2e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:20.337805 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bc7bfeea-a1c7-4eb5-806d-159fc607dd9b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:20.338133 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0b10582-e6b1-4ee8-8188-efa95d94c2e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:20.338539 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bc7bfeea-a1c7-4eb5-806d-159fc607dd9b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:20.338973 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bc7bfeea-a1c7-4eb5-806d-159fc607dd9b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:20.339342 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0b10582-e6b1-4ee8-8188-efa95d94c2e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:20.339923 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0b10582-e6b1-4ee8-8188-efa95d94c2e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:20.420572 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bc7bfeea-a1c7-4eb5-806d-159fc607dd9b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.095117 Dec 15 14:21:20.421255 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 878/1667] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:20 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:20.479587 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c0b10582-e6b1-4ee8-8188-efa95d94c2e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:20.487899 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c0b10582-e6b1-4ee8-8188-efa95d94c2e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.162647 Dec 15 14:21:20.488484 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 790/1668] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:20 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:20.697668 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3267ab43-0b97-46c6-9966-2ac842143243 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:20.698281 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3267ab43-0b97-46c6-9966-2ac842143243 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:20.706273 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3267ab43-0b97-46c6-9966-2ac842143243 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:20.706729 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3267ab43-0b97-46c6-9966-2ac842143243 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:20.707540 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3267ab43-0b97-46c6-9966-2ac842143243 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:20.708006 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3267ab43-0b97-46c6-9966-2ac842143243 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:20.851675 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3267ab43-0b97-46c6-9966-2ac842143243 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:20.860243 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3267ab43-0b97-46c6-9966-2ac842143243 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.166872 Dec 15 14:21:20.860804 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 879/1669] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:20 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:21.432733 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cae1d7e8-4099-4bef-9502-f4cc178fa260 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:21.433752 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cae1d7e8-4099-4bef-9502-f4cc178fa260 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:21.441087 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cae1d7e8-4099-4bef-9502-f4cc178fa260 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:21.441545 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cae1d7e8-4099-4bef-9502-f4cc178fa260 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:21.442366 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cae1d7e8-4099-4bef-9502-f4cc178fa260 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:21.442806 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cae1d7e8-4099-4bef-9502-f4cc178fa260 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:21.505723 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3dfd917a-822e-4d2a-8172-21c7c4d53d11 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:21.506401 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3dfd917a-822e-4d2a-8172-21c7c4d53d11 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:21.513584 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3dfd917a-822e-4d2a-8172-21c7c4d53d11 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:21.514052 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3dfd917a-822e-4d2a-8172-21c7c4d53d11 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:21.514839 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3dfd917a-822e-4d2a-8172-21c7c4d53d11 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:21.515269 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3dfd917a-822e-4d2a-8172-21c7c4d53d11 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:21.523437 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cae1d7e8-4099-4bef-9502-f4cc178fa260 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.094378 Dec 15 14:21:21.524090 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 791/1670] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:21 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:21.656294 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3dfd917a-822e-4d2a-8172-21c7c4d53d11 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:21.664446 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3dfd917a-822e-4d2a-8172-21c7c4d53d11 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.162491 Dec 15 14:21:21.665036 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 880/1671] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:21 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:21.878695 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-79d60e6d-da50-4143-b612-40ff51ea8b36 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:21.879394 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-79d60e6d-da50-4143-b612-40ff51ea8b36 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:21.886693 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79d60e6d-da50-4143-b612-40ff51ea8b36 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:21.887145 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79d60e6d-da50-4143-b612-40ff51ea8b36 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:21.887970 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79d60e6d-da50-4143-b612-40ff51ea8b36 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:21.888545 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79d60e6d-da50-4143-b612-40ff51ea8b36 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:22.028975 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-79d60e6d-da50-4143-b612-40ff51ea8b36 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:22.037769 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-79d60e6d-da50-4143-b612-40ff51ea8b36 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.163306 Dec 15 14:21:22.038345 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 792/1672] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:21 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:22.535616 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-836a1ba3-d3c2-43e8-8e0d-c0578336be53 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:22.536592 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-836a1ba3-d3c2-43e8-8e0d-c0578336be53 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:22.544029 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-836a1ba3-d3c2-43e8-8e0d-c0578336be53 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:22.544484 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-836a1ba3-d3c2-43e8-8e0d-c0578336be53 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:22.545303 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-836a1ba3-d3c2-43e8-8e0d-c0578336be53 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:22.545762 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-836a1ba3-d3c2-43e8-8e0d-c0578336be53 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:22.620643 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-836a1ba3-d3c2-43e8-8e0d-c0578336be53 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.088685 Dec 15 14:21:22.621280 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 881/1673] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:22 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:22.682120 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ce25a916-1bb9-4cb7-bd6f-10d53404a19a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:22.682848 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ce25a916-1bb9-4cb7-bd6f-10d53404a19a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:22.689772 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce25a916-1bb9-4cb7-bd6f-10d53404a19a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:22.690221 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce25a916-1bb9-4cb7-bd6f-10d53404a19a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:22.691019 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce25a916-1bb9-4cb7-bd6f-10d53404a19a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:22.691481 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce25a916-1bb9-4cb7-bd6f-10d53404a19a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:22.831459 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ce25a916-1bb9-4cb7-bd6f-10d53404a19a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:22.839409 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ce25a916-1bb9-4cb7-bd6f-10d53404a19a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.161160 Dec 15 14:21:22.839993 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 793/1674] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:22 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:23.056203 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c14ac154-b4dc-4bdb-bac7-647626d45e99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:23.056894 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c14ac154-b4dc-4bdb-bac7-647626d45e99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:23.064630 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c14ac154-b4dc-4bdb-bac7-647626d45e99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:23.065081 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c14ac154-b4dc-4bdb-bac7-647626d45e99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:23.065911 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c14ac154-b4dc-4bdb-bac7-647626d45e99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:23.066348 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c14ac154-b4dc-4bdb-bac7-647626d45e99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:23.207711 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c14ac154-b4dc-4bdb-bac7-647626d45e99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:23.216096 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c14ac154-b4dc-4bdb-bac7-647626d45e99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.164098 Dec 15 14:21:23.216804 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 882/1675] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:23 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:23.632853 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-044f32cf-7125-4cf1-8f89-3a0f351e85fd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:23.633857 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-044f32cf-7125-4cf1-8f89-3a0f351e85fd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:23.640962 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-044f32cf-7125-4cf1-8f89-3a0f351e85fd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:23.641450 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-044f32cf-7125-4cf1-8f89-3a0f351e85fd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:23.642332 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-044f32cf-7125-4cf1-8f89-3a0f351e85fd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:23.642768 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-044f32cf-7125-4cf1-8f89-3a0f351e85fd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:23.716772 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-044f32cf-7125-4cf1-8f89-3a0f351e85fd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.087545 Dec 15 14:21:23.717405 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 794/1676] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:23 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:23.857090 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3d3f8ed7-6345-4460-a244-b95b1ea5f9b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:23.857752 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3d3f8ed7-6345-4460-a244-b95b1ea5f9b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:23.864577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d3f8ed7-6345-4460-a244-b95b1ea5f9b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:23.865028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d3f8ed7-6345-4460-a244-b95b1ea5f9b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:23.865860 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d3f8ed7-6345-4460-a244-b95b1ea5f9b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:23.866305 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d3f8ed7-6345-4460-a244-b95b1ea5f9b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:24.009994 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3d3f8ed7-6345-4460-a244-b95b1ea5f9b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:24.018320 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3d3f8ed7-6345-4460-a244-b95b1ea5f9b0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.165066 Dec 15 14:21:24.018974 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 883/1677] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:23 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:24.234855 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d83ecc57-64d6-4b54-8cb5-e7d6b8f8a626 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:24.235544 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d83ecc57-64d6-4b54-8cb5-e7d6b8f8a626 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:24.249170 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d83ecc57-64d6-4b54-8cb5-e7d6b8f8a626 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:24.249663 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d83ecc57-64d6-4b54-8cb5-e7d6b8f8a626 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:24.250465 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d83ecc57-64d6-4b54-8cb5-e7d6b8f8a626 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:24.250921 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d83ecc57-64d6-4b54-8cb5-e7d6b8f8a626 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:24.385684 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d83ecc57-64d6-4b54-8cb5-e7d6b8f8a626 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:24.394483 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d83ecc57-64d6-4b54-8cb5-e7d6b8f8a626 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.164023 Dec 15 14:21:24.395043 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 795/1678] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:24 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:24.729079 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-875fd4b3-a6b2-485a-959e-c2c5d9a62383 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:24.729965 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-875fd4b3-a6b2-485a-959e-c2c5d9a62383 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:24.736835 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-875fd4b3-a6b2-485a-959e-c2c5d9a62383 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:24.737281 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-875fd4b3-a6b2-485a-959e-c2c5d9a62383 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:24.738099 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-875fd4b3-a6b2-485a-959e-c2c5d9a62383 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:24.738529 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-875fd4b3-a6b2-485a-959e-c2c5d9a62383 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:24.816133 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-875fd4b3-a6b2-485a-959e-c2c5d9a62383 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.090842 Dec 15 14:21:24.816806 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 884/1679] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:24 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:25.035678 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9b3d2673-1136-4b98-83f9-ca3be6c71367 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:25.036256 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9b3d2673-1136-4b98-83f9-ca3be6c71367 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:25.043272 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b3d2673-1136-4b98-83f9-ca3be6c71367 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:25.043721 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b3d2673-1136-4b98-83f9-ca3be6c71367 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:25.044632 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b3d2673-1136-4b98-83f9-ca3be6c71367 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:25.045077 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b3d2673-1136-4b98-83f9-ca3be6c71367 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:25.185755 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9b3d2673-1136-4b98-83f9-ca3be6c71367 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:25.193922 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9b3d2673-1136-4b98-83f9-ca3be6c71367 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.162080 Dec 15 14:21:25.194524 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 796/1680] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:25 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:25.412796 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-239f42db-9879-4712-968d-26878c9c1d4d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:25.413468 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-239f42db-9879-4712-968d-26878c9c1d4d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:25.421080 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-239f42db-9879-4712-968d-26878c9c1d4d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:25.421530 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-239f42db-9879-4712-968d-26878c9c1d4d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:25.422413 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-239f42db-9879-4712-968d-26878c9c1d4d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:25.423197 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-239f42db-9879-4712-968d-26878c9c1d4d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:25.567440 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-239f42db-9879-4712-968d-26878c9c1d4d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:25.576307 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-239f42db-9879-4712-968d-26878c9c1d4d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.167667 Dec 15 14:21:25.576880 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 885/1681] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:25 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:25.828731 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ab52f29d-6203-442d-a0da-2021d787eb97 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:25.829641 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ab52f29d-6203-442d-a0da-2021d787eb97 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:25.836469 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab52f29d-6203-442d-a0da-2021d787eb97 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:25.836916 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab52f29d-6203-442d-a0da-2021d787eb97 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:25.837716 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab52f29d-6203-442d-a0da-2021d787eb97 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:25.838145 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab52f29d-6203-442d-a0da-2021d787eb97 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:25.916703 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ab52f29d-6203-442d-a0da-2021d787eb97 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.092209 Dec 15 14:21:25.917364 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 797/1682] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:25 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:26.211882 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-adf4dc02-1c4c-42bc-b62d-5c4bbb4670dd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:26.212488 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-adf4dc02-1c4c-42bc-b62d-5c4bbb4670dd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:26.219714 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-adf4dc02-1c4c-42bc-b62d-5c4bbb4670dd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:26.220158 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-adf4dc02-1c4c-42bc-b62d-5c4bbb4670dd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:26.220946 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-adf4dc02-1c4c-42bc-b62d-5c4bbb4670dd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:26.221383 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-adf4dc02-1c4c-42bc-b62d-5c4bbb4670dd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:26.362857 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-adf4dc02-1c4c-42bc-b62d-5c4bbb4670dd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:26.370534 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-adf4dc02-1c4c-42bc-b62d-5c4bbb4670dd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.162445 Dec 15 14:21:26.371113 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 886/1683] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:26 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:26.594984 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-742f1a4f-ae02-44ca-af56-fdb952e3870f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:26.595675 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-742f1a4f-ae02-44ca-af56-fdb952e3870f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:26.603049 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-742f1a4f-ae02-44ca-af56-fdb952e3870f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:26.603498 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-742f1a4f-ae02-44ca-af56-fdb952e3870f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:26.604278 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-742f1a4f-ae02-44ca-af56-fdb952e3870f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:26.604709 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-742f1a4f-ae02-44ca-af56-fdb952e3870f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:26.743491 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-742f1a4f-ae02-44ca-af56-fdb952e3870f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:26.755994 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-742f1a4f-ae02-44ca-af56-fdb952e3870f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.164773 Dec 15 14:21:26.756860 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 798/1684] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:26 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:26.928826 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c600f62d-da86-48ab-947e-c111df0a62b1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:26.929882 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c600f62d-da86-48ab-947e-c111df0a62b1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:26.936936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c600f62d-da86-48ab-947e-c111df0a62b1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:26.937391 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c600f62d-da86-48ab-947e-c111df0a62b1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:26.938198 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c600f62d-da86-48ab-947e-c111df0a62b1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:26.938631 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c600f62d-da86-48ab-947e-c111df0a62b1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:27.025976 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c600f62d-da86-48ab-947e-c111df0a62b1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.100859 Dec 15 14:21:27.026855 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 887/1685] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:26 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:21:27.388022 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a45bd5a9-aec6-445e-80d0-f4800c4196f4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:27.388744 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a45bd5a9-aec6-445e-80d0-f4800c4196f4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:27.395334 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a45bd5a9-aec6-445e-80d0-f4800c4196f4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:27.395781 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a45bd5a9-aec6-445e-80d0-f4800c4196f4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:27.396556 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a45bd5a9-aec6-445e-80d0-f4800c4196f4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:27.396999 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a45bd5a9-aec6-445e-80d0-f4800c4196f4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:27.539576 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a45bd5a9-aec6-445e-80d0-f4800c4196f4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:27.548508 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a45bd5a9-aec6-445e-80d0-f4800c4196f4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.164272 Dec 15 14:21:27.549108 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 799/1686] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:27 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:27.775613 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-760f12bb-15e1-4330-8613-3a8a00bd5e1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:27.776218 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-760f12bb-15e1-4330-8613-3a8a00bd5e1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:27.783708 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-760f12bb-15e1-4330-8613-3a8a00bd5e1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:27.784178 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-760f12bb-15e1-4330-8613-3a8a00bd5e1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:27.785033 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-760f12bb-15e1-4330-8613-3a8a00bd5e1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:27.785494 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-760f12bb-15e1-4330-8613-3a8a00bd5e1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:27.930402 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-760f12bb-15e1-4330-8613-3a8a00bd5e1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:27.939537 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-760f12bb-15e1-4330-8613-3a8a00bd5e1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.168105 Dec 15 14:21:27.940111 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 888/1687] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:27 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:28.038064 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d303e8f1-0715-481e-8fff-99205130e3e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:28.038916 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d303e8f1-0715-481e-8fff-99205130e3e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:28.045881 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d303e8f1-0715-481e-8fff-99205130e3e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:28.046326 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d303e8f1-0715-481e-8fff-99205130e3e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:28.047119 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d303e8f1-0715-481e-8fff-99205130e3e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:28.047554 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d303e8f1-0715-481e-8fff-99205130e3e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:28.139691 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d303e8f1-0715-481e-8fff-99205130e3e1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.105262 Dec 15 14:21:28.140544 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 800/1688] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:28 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:28.567314 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-38ff35fb-dd14-4de5-99c1-4e00d9f4be2a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:28.567946 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-38ff35fb-dd14-4de5-99c1-4e00d9f4be2a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:28.574808 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38ff35fb-dd14-4de5-99c1-4e00d9f4be2a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:28.575256 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38ff35fb-dd14-4de5-99c1-4e00d9f4be2a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:28.576161 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38ff35fb-dd14-4de5-99c1-4e00d9f4be2a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:28.576570 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38ff35fb-dd14-4de5-99c1-4e00d9f4be2a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:28.723000 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-38ff35fb-dd14-4de5-99c1-4e00d9f4be2a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:28.731276 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-38ff35fb-dd14-4de5-99c1-4e00d9f4be2a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.168161 Dec 15 14:21:28.731931 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 889/1689] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:28 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:28.957644 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bc2c5bf8-6185-41f7-bb6c-b5db976e3183 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:28.961050 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bc2c5bf8-6185-41f7-bb6c-b5db976e3183 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:28.968494 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc2c5bf8-6185-41f7-bb6c-b5db976e3183 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:28.969007 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc2c5bf8-6185-41f7-bb6c-b5db976e3183 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:28.970281 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc2c5bf8-6185-41f7-bb6c-b5db976e3183 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:28.970888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc2c5bf8-6185-41f7-bb6c-b5db976e3183 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:29.121737 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bc2c5bf8-6185-41f7-bb6c-b5db976e3183 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:29.130146 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bc2c5bf8-6185-41f7-bb6c-b5db976e3183 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.176713 Dec 15 14:21:29.130720 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 801/1690] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:28 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:29.153682 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5d09c4bb-0adf-4acd-a8e4-b65e6a5a2635 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:29.155382 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5d09c4bb-0adf-4acd-a8e4-b65e6a5a2635 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:29.163026 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5d09c4bb-0adf-4acd-a8e4-b65e6a5a2635 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:29.163478 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5d09c4bb-0adf-4acd-a8e4-b65e6a5a2635 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:29.164277 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5d09c4bb-0adf-4acd-a8e4-b65e6a5a2635 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:29.164705 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5d09c4bb-0adf-4acd-a8e4-b65e6a5a2635 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:29.247803 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5d09c4bb-0adf-4acd-a8e4-b65e6a5a2635 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.098854 Dec 15 14:21:29.248341 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 890/1691] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:29 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:21:29.752337 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0c46a4ee-af81-48b1-b5b8-8eea7d957ec7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:29.753085 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0c46a4ee-af81-48b1-b5b8-8eea7d957ec7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:29.762212 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0c46a4ee-af81-48b1-b5b8-8eea7d957ec7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:29.762666 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0c46a4ee-af81-48b1-b5b8-8eea7d957ec7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:29.763483 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0c46a4ee-af81-48b1-b5b8-8eea7d957ec7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:29.763922 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0c46a4ee-af81-48b1-b5b8-8eea7d957ec7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:29.919464 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0c46a4ee-af81-48b1-b5b8-8eea7d957ec7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:29.932851 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0c46a4ee-af81-48b1-b5b8-8eea7d957ec7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.185990 Dec 15 14:21:29.933736 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 802/1692] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:29 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:30.151712 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c922a4b4-8349-4cc6-bc2d-54032aca45a5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:30.152702 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c922a4b4-8349-4cc6-bc2d-54032aca45a5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:30.160704 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c922a4b4-8349-4cc6-bc2d-54032aca45a5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:30.161350 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c922a4b4-8349-4cc6-bc2d-54032aca45a5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:30.161966 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c922a4b4-8349-4cc6-bc2d-54032aca45a5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:30.162405 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c922a4b4-8349-4cc6-bc2d-54032aca45a5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:30.260524 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f59be8f1-4a84-4858-bbb2-649f9df1b54d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:30.261526 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f59be8f1-4a84-4858-bbb2-649f9df1b54d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:30.268602 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f59be8f1-4a84-4858-bbb2-649f9df1b54d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:30.269052 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f59be8f1-4a84-4858-bbb2-649f9df1b54d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:30.269900 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f59be8f1-4a84-4858-bbb2-649f9df1b54d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:30.270336 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f59be8f1-4a84-4858-bbb2-649f9df1b54d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:30.307425 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c922a4b4-8349-4cc6-bc2d-54032aca45a5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:30.319343 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c922a4b4-8349-4cc6-bc2d-54032aca45a5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.173871 Dec 15 14:21:30.319915 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 891/1693] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:30 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:30.350897 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f59be8f1-4a84-4858-bbb2-649f9df1b54d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.095171 Dec 15 14:21:30.351551 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 803/1694] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:30 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:30.952334 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e8a8171d-005b-43fe-8f53-4a398fd7498c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:30.952927 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e8a8171d-005b-43fe-8f53-4a398fd7498c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:30.960212 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8a8171d-005b-43fe-8f53-4a398fd7498c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:30.960668 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8a8171d-005b-43fe-8f53-4a398fd7498c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:30.961447 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8a8171d-005b-43fe-8f53-4a398fd7498c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:30.961897 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8a8171d-005b-43fe-8f53-4a398fd7498c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:31.135515 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e8a8171d-005b-43fe-8f53-4a398fd7498c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:31.144110 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e8a8171d-005b-43fe-8f53-4a398fd7498c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.195974 Dec 15 14:21:31.144684 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 892/1695] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:30 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:21:31.341048 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-69a8b7de-43c7-4a6b-b1b5-5d2ac69fb04e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:31.341793 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-69a8b7de-43c7-4a6b-b1b5-5d2ac69fb04e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:31.349181 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69a8b7de-43c7-4a6b-b1b5-5d2ac69fb04e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:31.349657 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69a8b7de-43c7-4a6b-b1b5-5d2ac69fb04e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:31.350461 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69a8b7de-43c7-4a6b-b1b5-5d2ac69fb04e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:31.350899 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69a8b7de-43c7-4a6b-b1b5-5d2ac69fb04e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:31.364093 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6342f26e-42e8-45e2-94b1-1754e3c2b2d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:31.365061 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6342f26e-42e8-45e2-94b1-1754e3c2b2d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:31.371988 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6342f26e-42e8-45e2-94b1-1754e3c2b2d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:31.372430 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6342f26e-42e8-45e2-94b1-1754e3c2b2d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:31.373218 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6342f26e-42e8-45e2-94b1-1754e3c2b2d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:31.373638 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6342f26e-42e8-45e2-94b1-1754e3c2b2d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:31.463844 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6342f26e-42e8-45e2-94b1-1754e3c2b2d4 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.103469 Dec 15 14:21:31.464526 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 893/1696] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:31 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:31.493655 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-69a8b7de-43c7-4a6b-b1b5-5d2ac69fb04e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:31.506319 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-69a8b7de-43c7-4a6b-b1b5-5d2ac69fb04e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.169648 Dec 15 14:21:31.507189 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 804/1697] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:31 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:32.162541 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dcd46757-7bd1-4621-9f05-356c27c863fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:32.163534 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dcd46757-7bd1-4621-9f05-356c27c863fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:32.174134 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dcd46757-7bd1-4621-9f05-356c27c863fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:32.174342 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dcd46757-7bd1-4621-9f05-356c27c863fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:32.175143 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dcd46757-7bd1-4621-9f05-356c27c863fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:32.175575 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dcd46757-7bd1-4621-9f05-356c27c863fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:32.336650 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dcd46757-7bd1-4621-9f05-356c27c863fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:32.348485 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dcd46757-7bd1-4621-9f05-356c27c863fe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.190655 Dec 15 14:21:32.349136 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 894/1698] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:32 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:32.478815 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b412e429-087d-4578-a2a3-e5210944cdb9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:32.479702 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b412e429-087d-4578-a2a3-e5210944cdb9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:32.490425 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b412e429-087d-4578-a2a3-e5210944cdb9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:32.491170 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b412e429-087d-4578-a2a3-e5210944cdb9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:32.492460 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b412e429-087d-4578-a2a3-e5210944cdb9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:32.493179 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b412e429-087d-4578-a2a3-e5210944cdb9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:32.527079 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0da7cdc8-66c1-43b9-90fd-c749ddcf99c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:32.527963 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0da7cdc8-66c1-43b9-90fd-c749ddcf99c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:32.535493 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0da7cdc8-66c1-43b9-90fd-c749ddcf99c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:32.535946 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0da7cdc8-66c1-43b9-90fd-c749ddcf99c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:32.536763 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0da7cdc8-66c1-43b9-90fd-c749ddcf99c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:32.537422 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0da7cdc8-66c1-43b9-90fd-c749ddcf99c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:32.573528 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b412e429-087d-4578-a2a3-e5210944cdb9 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.100203 Dec 15 14:21:32.574654 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 805/1699] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:32 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:32.704787 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0da7cdc8-66c1-43b9-90fd-c749ddcf99c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:32.715726 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0da7cdc8-66c1-43b9-90fd-c749ddcf99c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.193915 Dec 15 14:21:32.716558 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 895/1700] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:32 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:33.371113 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f7601840-58ce-4f0e-8d92-c78f60e1ee07 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:33.371837 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f7601840-58ce-4f0e-8d92-c78f60e1ee07 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:33.379163 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7601840-58ce-4f0e-8d92-c78f60e1ee07 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:33.379616 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7601840-58ce-4f0e-8d92-c78f60e1ee07 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:33.380399 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7601840-58ce-4f0e-8d92-c78f60e1ee07 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:33.380821 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7601840-58ce-4f0e-8d92-c78f60e1ee07 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:33.551995 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f7601840-58ce-4f0e-8d92-c78f60e1ee07 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:33.563058 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f7601840-58ce-4f0e-8d92-c78f60e1ee07 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.196116 Dec 15 14:21:33.563929 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 806/1701] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:33 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:33.588686 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-85cb0607-9c54-482d-b1c1-4367a2a57d34 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:33.589890 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-85cb0607-9c54-482d-b1c1-4367a2a57d34 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:33.598757 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85cb0607-9c54-482d-b1c1-4367a2a57d34 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:33.599207 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85cb0607-9c54-482d-b1c1-4367a2a57d34 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:33.599997 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85cb0607-9c54-482d-b1c1-4367a2a57d34 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:33.600430 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85cb0607-9c54-482d-b1c1-4367a2a57d34 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:33.682726 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-85cb0607-9c54-482d-b1c1-4367a2a57d34 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.098977 Dec 15 14:21:33.683321 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 896/1702] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:33 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:33.735167 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a942676a-4118-4323-bdcb-99c8f098af67 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:33.735833 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a942676a-4118-4323-bdcb-99c8f098af67 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:33.743179 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a942676a-4118-4323-bdcb-99c8f098af67 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:33.743625 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a942676a-4118-4323-bdcb-99c8f098af67 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:33.744406 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a942676a-4118-4323-bdcb-99c8f098af67 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:33.744859 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a942676a-4118-4323-bdcb-99c8f098af67 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:33.890054 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a942676a-4118-4323-bdcb-99c8f098af67 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:33.898460 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a942676a-4118-4323-bdcb-99c8f098af67 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.167171 Dec 15 14:21:33.899051 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 807/1703] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:33 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:34.585293 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-51051cac-163b-4c4f-a313-c68605f133c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:34.586149 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-51051cac-163b-4c4f-a313-c68605f133c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:34.593013 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-51051cac-163b-4c4f-a313-c68605f133c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:34.593640 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-51051cac-163b-4c4f-a313-c68605f133c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:34.594298 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-51051cac-163b-4c4f-a313-c68605f133c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:34.594737 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-51051cac-163b-4c4f-a313-c68605f133c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:34.695683 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-da9267e0-ce19-49a2-9f74-16873dab91ea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:34.696548 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-da9267e0-ce19-49a2-9f74-16873dab91ea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:34.703447 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da9267e0-ce19-49a2-9f74-16873dab91ea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:34.703904 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da9267e0-ce19-49a2-9f74-16873dab91ea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:34.704679 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da9267e0-ce19-49a2-9f74-16873dab91ea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:34.705768 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da9267e0-ce19-49a2-9f74-16873dab91ea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:34.791846 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-da9267e0-ce19-49a2-9f74-16873dab91ea tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.100625 Dec 15 14:21:34.792506 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 808/1704] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:34 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:21:34.826542 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-51051cac-163b-4c4f-a313-c68605f133c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:34.834943 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-51051cac-163b-4c4f-a313-c68605f133c0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.254711 Dec 15 14:21:34.836016 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 897/1705] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:34 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:34.917590 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2ab11f26-110d-458d-ab60-fc3503a547d9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:34.918460 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2ab11f26-110d-458d-ab60-fc3503a547d9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:34.926941 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ab11f26-110d-458d-ab60-fc3503a547d9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:34.927413 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ab11f26-110d-458d-ab60-fc3503a547d9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:34.928270 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ab11f26-110d-458d-ab60-fc3503a547d9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:34.928723 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ab11f26-110d-458d-ab60-fc3503a547d9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:35.101543 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2ab11f26-110d-458d-ab60-fc3503a547d9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:35.114867 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2ab11f26-110d-458d-ab60-fc3503a547d9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.201919 Dec 15 14:21:35.115522 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 809/1706] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:34 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:35.804797 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6c90df51-8503-4dea-bde6-08eb555ea18a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:35.805588 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6c90df51-8503-4dea-bde6-08eb555ea18a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:35.813756 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c90df51-8503-4dea-bde6-08eb555ea18a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:35.814193 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c90df51-8503-4dea-bde6-08eb555ea18a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:35.814990 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c90df51-8503-4dea-bde6-08eb555ea18a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:35.815432 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c90df51-8503-4dea-bde6-08eb555ea18a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:35.853057 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-836f158c-5bba-4a83-a303-0f28c2cb227b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:35.853710 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-836f158c-5bba-4a83-a303-0f28c2cb227b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:35.867204 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-836f158c-5bba-4a83-a303-0f28c2cb227b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:35.867666 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-836f158c-5bba-4a83-a303-0f28c2cb227b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:35.868489 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-836f158c-5bba-4a83-a303-0f28c2cb227b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:35.868923 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-836f158c-5bba-4a83-a303-0f28c2cb227b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:35.896544 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6c90df51-8503-4dea-bde6-08eb555ea18a tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.095975 Dec 15 14:21:35.897498 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 898/1707] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:35 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:36.016716 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-836f158c-5bba-4a83-a303-0f28c2cb227b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:36.025359 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-836f158c-5bba-4a83-a303-0f28c2cb227b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.176680 Dec 15 14:21:36.026029 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 810/1708] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:35 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:36.137671 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9c9beb2f-5601-4a9f-bec2-4b03edb49af0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:36.138417 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9c9beb2f-5601-4a9f-bec2-4b03edb49af0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:36.146319 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c9beb2f-5601-4a9f-bec2-4b03edb49af0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:36.146743 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c9beb2f-5601-4a9f-bec2-4b03edb49af0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:36.147721 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c9beb2f-5601-4a9f-bec2-4b03edb49af0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:36.148197 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c9beb2f-5601-4a9f-bec2-4b03edb49af0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:36.305962 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9c9beb2f-5601-4a9f-bec2-4b03edb49af0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:36.315000 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9c9beb2f-5601-4a9f-bec2-4b03edb49af0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.182326 Dec 15 14:21:36.315840 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 899/1709] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:36 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:36.908924 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9c631e38-deb5-413d-87de-b1656b5e67a5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:36.910047 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9c631e38-deb5-413d-87de-b1656b5e67a5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:36.917484 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c631e38-deb5-413d-87de-b1656b5e67a5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:36.917973 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c631e38-deb5-413d-87de-b1656b5e67a5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:36.918801 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c631e38-deb5-413d-87de-b1656b5e67a5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:36.919242 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c631e38-deb5-413d-87de-b1656b5e67a5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:36.998352 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9c631e38-deb5-413d-87de-b1656b5e67a5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.092736 Dec 15 14:21:36.999140 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 811/1710] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:36 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:37.044458 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-700d89c0-fad9-4df7-a036-fab020f4264a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:37.045064 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-700d89c0-fad9-4df7-a036-fab020f4264a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:37.052108 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-700d89c0-fad9-4df7-a036-fab020f4264a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:37.052568 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-700d89c0-fad9-4df7-a036-fab020f4264a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:37.053371 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-700d89c0-fad9-4df7-a036-fab020f4264a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:37.053970 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-700d89c0-fad9-4df7-a036-fab020f4264a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:37.209521 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-700d89c0-fad9-4df7-a036-fab020f4264a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:37.221427 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-700d89c0-fad9-4df7-a036-fab020f4264a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.181429 Dec 15 14:21:37.221996 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 900/1711] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:37 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:37.339115 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dc8cb092-dace-4d67-9194-dec9f0ed9a60 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:37.339875 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dc8cb092-dace-4d67-9194-dec9f0ed9a60 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:37.347086 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc8cb092-dace-4d67-9194-dec9f0ed9a60 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:37.347601 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc8cb092-dace-4d67-9194-dec9f0ed9a60 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:37.348412 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc8cb092-dace-4d67-9194-dec9f0ed9a60 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:37.348856 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc8cb092-dace-4d67-9194-dec9f0ed9a60 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:37.510646 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dc8cb092-dace-4d67-9194-dec9f0ed9a60 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:37.518913 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dc8cb092-dace-4d67-9194-dec9f0ed9a60 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.184368 Dec 15 14:21:37.519447 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 812/1712] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:37 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:38.012942 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5e7362c4-4628-4069-adfc-b89fda924ff8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:38.013893 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5e7362c4-4628-4069-adfc-b89fda924ff8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:38.020599 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e7362c4-4628-4069-adfc-b89fda924ff8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:38.021066 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e7362c4-4628-4069-adfc-b89fda924ff8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:38.021909 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e7362c4-4628-4069-adfc-b89fda924ff8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:38.022330 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e7362c4-4628-4069-adfc-b89fda924ff8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:38.111434 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5e7362c4-4628-4069-adfc-b89fda924ff8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 28623 microversion: 2.20 time: 0.101799 Dec 15 14:21:38.112660 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 901/1713] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:38 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 28623 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:38.240387 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2e80a8d9-ba7f-47d5-ba98-e05b8c9b8b0e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:38.241050 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2e80a8d9-ba7f-47d5-ba98-e05b8c9b8b0e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:38.250393 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e80a8d9-ba7f-47d5-ba98-e05b8c9b8b0e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:38.250976 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e80a8d9-ba7f-47d5-ba98-e05b8c9b8b0e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:38.252092 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e80a8d9-ba7f-47d5-ba98-e05b8c9b8b0e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:38.252720 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e80a8d9-ba7f-47d5-ba98-e05b8c9b8b0e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:38.411597 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2e80a8d9-ba7f-47d5-ba98-e05b8c9b8b0e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:38.420517 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2e80a8d9-ba7f-47d5-ba98-e05b8c9b8b0e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.184088 Dec 15 14:21:38.421065 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 813/1714] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:38 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:38.538215 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5eeaf236-8cca-4b4e-9f11-c3886d96ab31 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:38.539022 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5eeaf236-8cca-4b4e-9f11-c3886d96ab31 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:38.547777 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5eeaf236-8cca-4b4e-9f11-c3886d96ab31 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:38.548297 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5eeaf236-8cca-4b4e-9f11-c3886d96ab31 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:38.549216 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5eeaf236-8cca-4b4e-9f11-c3886d96ab31 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:38.549766 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5eeaf236-8cca-4b4e-9f11-c3886d96ab31 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:38.708206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5eeaf236-8cca-4b4e-9f11-c3886d96ab31 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:38.717567 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5eeaf236-8cca-4b4e-9f11-c3886d96ab31 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.184233 Dec 15 14:21:38.718219 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 902/1715] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:38 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:39.129415 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2f5da015-9050-438d-ba4b-7222a9792eee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:39.130848 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2f5da015-9050-438d-ba4b-7222a9792eee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:39.138882 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f5da015-9050-438d-ba4b-7222a9792eee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:39.139330 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f5da015-9050-438d-ba4b-7222a9792eee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:39.140381 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f5da015-9050-438d-ba4b-7222a9792eee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:39.141096 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f5da015-9050-438d-ba4b-7222a9792eee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:39.225883 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2f5da015-9050-438d-ba4b-7222a9792eee tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 29187 microversion: 2.20 time: 0.102765 Dec 15 14:21:39.226741 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 814/1716] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:39 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 29187 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:39.445056 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-87de72ab-0da1-4416-8bfd-b05212131c58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:39.445711 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-87de72ab-0da1-4416-8bfd-b05212131c58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:39.452832 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87de72ab-0da1-4416-8bfd-b05212131c58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:39.453287 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87de72ab-0da1-4416-8bfd-b05212131c58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:39.454180 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87de72ab-0da1-4416-8bfd-b05212131c58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:39.454612 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87de72ab-0da1-4416-8bfd-b05212131c58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:39.614075 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-87de72ab-0da1-4416-8bfd-b05212131c58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:39.625083 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-87de72ab-0da1-4416-8bfd-b05212131c58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.186409 Dec 15 14:21:39.625889 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 903/1717] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:39 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:39.738956 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-130344ef-f1e3-4933-a95b-bc888a17b897 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:39.739535 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-130344ef-f1e3-4933-a95b-bc888a17b897 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:39.747608 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-130344ef-f1e3-4933-a95b-bc888a17b897 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:39.748062 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-130344ef-f1e3-4933-a95b-bc888a17b897 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:39.748853 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-130344ef-f1e3-4933-a95b-bc888a17b897 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:39.749292 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-130344ef-f1e3-4933-a95b-bc888a17b897 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:39.905772 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-130344ef-f1e3-4933-a95b-bc888a17b897 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:39.917972 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-130344ef-f1e3-4933-a95b-bc888a17b897 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.183020 Dec 15 14:21:39.918871 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 815/1718] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:39 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:40.239552 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7ff39f95-b6f2-434e-8b99-6aa220325cdd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:40.240542 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7ff39f95-b6f2-434e-8b99-6aa220325cdd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:40.247361 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7ff39f95-b6f2-434e-8b99-6aa220325cdd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:40.247828 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7ff39f95-b6f2-434e-8b99-6aa220325cdd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:40.248599 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7ff39f95-b6f2-434e-8b99-6aa220325cdd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:40.249029 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7ff39f95-b6f2-434e-8b99-6aa220325cdd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:40.336134 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7ff39f95-b6f2-434e-8b99-6aa220325cdd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 31275 microversion: 2.20 time: 0.099839 Dec 15 14:21:40.336795 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 904/1719] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:40 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 31275 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:40.648219 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-79c04716-629a-4e50-9855-85e5ee68b382 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:40.649068 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-79c04716-629a-4e50-9855-85e5ee68b382 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:40.656008 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79c04716-629a-4e50-9855-85e5ee68b382 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:40.656464 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79c04716-629a-4e50-9855-85e5ee68b382 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:40.657258 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79c04716-629a-4e50-9855-85e5ee68b382 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:40.657718 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79c04716-629a-4e50-9855-85e5ee68b382 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:40.810770 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-79c04716-629a-4e50-9855-85e5ee68b382 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:40.818426 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-79c04716-629a-4e50-9855-85e5ee68b382 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.176272 Dec 15 14:21:40.819028 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 816/1720] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:40 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:40.945195 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d1fb5590-1fe9-4b61-86f4-9b1465613c1f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:40.946598 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d1fb5590-1fe9-4b61-86f4-9b1465613c1f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:40.954499 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1fb5590-1fe9-4b61-86f4-9b1465613c1f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:40.954986 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1fb5590-1fe9-4b61-86f4-9b1465613c1f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:40.955763 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1fb5590-1fe9-4b61-86f4-9b1465613c1f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:40.956196 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1fb5590-1fe9-4b61-86f4-9b1465613c1f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:41.107507 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d1fb5590-1fe9-4b61-86f4-9b1465613c1f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:41.119827 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d1fb5590-1fe9-4b61-86f4-9b1465613c1f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.181160 Dec 15 14:21:41.120712 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 905/1721] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:40 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:41.354353 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-af1f5669-60d0-4128-b442-749b48838d05 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:41.355380 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-af1f5669-60d0-4128-b442-749b48838d05 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:41.365409 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af1f5669-60d0-4128-b442-749b48838d05 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:41.366017 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af1f5669-60d0-4128-b442-749b48838d05 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:41.367172 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af1f5669-60d0-4128-b442-749b48838d05 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:41.367830 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af1f5669-60d0-4128-b442-749b48838d05 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:41.457182 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-af1f5669-60d0-4128-b442-749b48838d05 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 33033 microversion: 2.20 time: 0.109186 Dec 15 14:21:41.457877 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 817/1722] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:41 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 33033 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:41.835873 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fb3387fb-94c4-4ed3-8324-a85e2d094240 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:41.836541 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fb3387fb-94c4-4ed3-8324-a85e2d094240 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:41.843579 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb3387fb-94c4-4ed3-8324-a85e2d094240 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:41.844030 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb3387fb-94c4-4ed3-8324-a85e2d094240 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:41.844810 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb3387fb-94c4-4ed3-8324-a85e2d094240 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:41.845242 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb3387fb-94c4-4ed3-8324-a85e2d094240 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:41.993975 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fb3387fb-94c4-4ed3-8324-a85e2d094240 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:42.001895 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fb3387fb-94c4-4ed3-8324-a85e2d094240 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.169763 Dec 15 14:21:42.002489 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 906/1723] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:41 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:42.149069 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4a46c1dc-03a6-49c7-bba5-55353f68555f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:42.149069 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4a46c1dc-03a6-49c7-bba5-55353f68555f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:42.157513 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a46c1dc-03a6-49c7-bba5-55353f68555f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:42.158003 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a46c1dc-03a6-49c7-bba5-55353f68555f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:42.158797 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a46c1dc-03a6-49c7-bba5-55353f68555f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:42.159234 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a46c1dc-03a6-49c7-bba5-55353f68555f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:42.308173 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4a46c1dc-03a6-49c7-bba5-55353f68555f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:42.319830 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4a46c1dc-03a6-49c7-bba5-55353f68555f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.176958 Dec 15 14:21:42.320493 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 818/1724] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:42 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:42.469991 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9abd0916-d5b8-4e3f-8ccd-3e085916319d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:42.470917 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9abd0916-d5b8-4e3f-8ccd-3e085916319d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:42.478031 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9abd0916-d5b8-4e3f-8ccd-3e085916319d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:42.478486 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9abd0916-d5b8-4e3f-8ccd-3e085916319d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:42.479399 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9abd0916-d5b8-4e3f-8ccd-3e085916319d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:42.479910 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9abd0916-d5b8-4e3f-8ccd-3e085916319d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:42.577899 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9abd0916-d5b8-4e3f-8ccd-3e085916319d tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 33942 microversion: 2.20 time: 0.111579 Dec 15 14:21:42.578577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 907/1725] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:42 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 33942 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:42.840059 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:21:42.840277 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:21:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:21:43.020259 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b72fced8-df38-474e-a4ff-ad8d7d4e96c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:43.020872 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b72fced8-df38-474e-a4ff-ad8d7d4e96c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:43.028265 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b72fced8-df38-474e-a4ff-ad8d7d4e96c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:43.028712 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b72fced8-df38-474e-a4ff-ad8d7d4e96c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:43.029941 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b72fced8-df38-474e-a4ff-ad8d7d4e96c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:43.030648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b72fced8-df38-474e-a4ff-ad8d7d4e96c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:43.185120 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b72fced8-df38-474e-a4ff-ad8d7d4e96c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:43.198158 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b72fced8-df38-474e-a4ff-ad8d7d4e96c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.181219 Dec 15 14:21:43.198722 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 819/1726] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:43 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:43.343346 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bce4bfa4-4f3a-4f2e-95fc-b53aa47d88ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:43.344147 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bce4bfa4-4f3a-4f2e-95fc-b53aa47d88ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:43.355147 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bce4bfa4-4f3a-4f2e-95fc-b53aa47d88ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:43.355147 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bce4bfa4-4f3a-4f2e-95fc-b53aa47d88ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:43.355927 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bce4bfa4-4f3a-4f2e-95fc-b53aa47d88ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:43.356366 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bce4bfa4-4f3a-4f2e-95fc-b53aa47d88ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:43.514581 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bce4bfa4-4f3a-4f2e-95fc-b53aa47d88ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:43.523067 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bce4bfa4-4f3a-4f2e-95fc-b53aa47d88ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.184196 Dec 15 14:21:43.523684 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 908/1727] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:43 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:43.591216 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f3e43fd1-0614-42e0-916e-af07700478f1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:43.592107 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f3e43fd1-0614-42e0-916e-af07700478f1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:43.598925 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f3e43fd1-0614-42e0-916e-af07700478f1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:43.599372 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f3e43fd1-0614-42e0-916e-af07700478f1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:43.600175 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f3e43fd1-0614-42e0-916e-af07700478f1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:43.600610 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f3e43fd1-0614-42e0-916e-af07700478f1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:43.686852 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f3e43fd1-0614-42e0-916e-af07700478f1 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 35218 microversion: 2.20 time: 0.100037 Dec 15 14:21:43.687416 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 820/1728] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:43 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 35218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:44.217618 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-96900640-8a96-4a29-8769-1287c5646a3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:44.218250 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-96900640-8a96-4a29-8769-1287c5646a3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:44.225288 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96900640-8a96-4a29-8769-1287c5646a3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:44.225844 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96900640-8a96-4a29-8769-1287c5646a3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:44.226627 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96900640-8a96-4a29-8769-1287c5646a3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:44.227058 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96900640-8a96-4a29-8769-1287c5646a3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:44.381391 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-96900640-8a96-4a29-8769-1287c5646a3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:44.389559 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-96900640-8a96-4a29-8769-1287c5646a3e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.176254 Dec 15 14:21:44.390221 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 909/1729] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:44 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:44.541704 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-90f5e182-3694-4782-877c-e98a0feeb8c5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:44.542546 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-90f5e182-3694-4782-877c-e98a0feeb8c5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:44.550262 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90f5e182-3694-4782-877c-e98a0feeb8c5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:44.550706 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90f5e182-3694-4782-877c-e98a0feeb8c5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:44.551505 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90f5e182-3694-4782-877c-e98a0feeb8c5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:44.551949 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90f5e182-3694-4782-877c-e98a0feeb8c5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:44.699454 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3eb73718-8614-4292-9bd3-5c55a58b3ee5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:44.700459 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3eb73718-8614-4292-9bd3-5c55a58b3ee5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:44.707715 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3eb73718-8614-4292-9bd3-5c55a58b3ee5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:44.708170 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3eb73718-8614-4292-9bd3-5c55a58b3ee5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:44.708970 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3eb73718-8614-4292-9bd3-5c55a58b3ee5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:44.709403 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3eb73718-8614-4292-9bd3-5c55a58b3ee5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:44.716571 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90f5e182-3694-4782-877c-e98a0feeb8c5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:44.724967 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-90f5e182-3694-4782-877c-e98a0feeb8c5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.187605 Dec 15 14:21:44.725547 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 821/1730] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:44 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:44.802226 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3eb73718-8614-4292-9bd3-5c55a58b3ee5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 36578 microversion: 2.20 time: 0.106553 Dec 15 14:21:44.802828 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 910/1731] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:44 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 36578 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:45.407645 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2b79b9c3-aba7-4da2-867a-c164128432e7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:45.408357 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2b79b9c3-aba7-4da2-867a-c164128432e7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:45.415759 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2b79b9c3-aba7-4da2-867a-c164128432e7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:45.416236 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2b79b9c3-aba7-4da2-867a-c164128432e7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:45.417024 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2b79b9c3-aba7-4da2-867a-c164128432e7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:45.417465 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2b79b9c3-aba7-4da2-867a-c164128432e7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:45.580459 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2b79b9c3-aba7-4da2-867a-c164128432e7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:45.590101 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2b79b9c3-aba7-4da2-867a-c164128432e7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.186404 Dec 15 14:21:45.590809 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 822/1732] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:45 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:45.744352 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6188c952-3ab7-422e-bc0a-795f89c345a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:45.744988 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6188c952-3ab7-422e-bc0a-795f89c345a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:45.753018 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6188c952-3ab7-422e-bc0a-795f89c345a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:45.753461 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6188c952-3ab7-422e-bc0a-795f89c345a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:45.754280 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6188c952-3ab7-422e-bc0a-795f89c345a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:45.754708 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6188c952-3ab7-422e-bc0a-795f89c345a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:45.815971 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e9def31f-61fc-4960-8260-010a59affc77 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:45.817052 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e9def31f-61fc-4960-8260-010a59affc77 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:45.824314 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e9def31f-61fc-4960-8260-010a59affc77 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:45.824764 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e9def31f-61fc-4960-8260-010a59affc77 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:45.825588 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e9def31f-61fc-4960-8260-010a59affc77 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:45.826054 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e9def31f-61fc-4960-8260-010a59affc77 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:45.910491 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e9def31f-61fc-4960-8260-010a59affc77 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 38107 microversion: 2.20 time: 0.098722 Dec 15 14:21:45.911175 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 823/1733] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:45 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 38107 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:21:45.912904 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6188c952-3ab7-422e-bc0a-795f89c345a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:45.922514 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6188c952-3ab7-422e-bc0a-795f89c345a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.182829 Dec 15 14:21:45.923517 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 911/1734] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:45 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:46.612137 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fc3cc6fb-0406-44d9-9e0a-06ade1bc8671 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:46.612781 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fc3cc6fb-0406-44d9-9e0a-06ade1bc8671 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:46.621583 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc3cc6fb-0406-44d9-9e0a-06ade1bc8671 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:46.622181 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc3cc6fb-0406-44d9-9e0a-06ade1bc8671 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:46.623038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc3cc6fb-0406-44d9-9e0a-06ade1bc8671 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:46.623517 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc3cc6fb-0406-44d9-9e0a-06ade1bc8671 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:46.792563 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fc3cc6fb-0406-44d9-9e0a-06ade1bc8671 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:46.802305 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fc3cc6fb-0406-44d9-9e0a-06ade1bc8671 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.195433 Dec 15 14:21:46.803004 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 824/1735] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:46 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:46.924103 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c1e1b58f-e1c0-488e-b08e-44b9c6035f76 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:46.924927 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c1e1b58f-e1c0-488e-b08e-44b9c6035f76 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:46.936114 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1e1b58f-e1c0-488e-b08e-44b9c6035f76 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:46.936579 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1e1b58f-e1c0-488e-b08e-44b9c6035f76 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:46.938056 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1e1b58f-e1c0-488e-b08e-44b9c6035f76 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:46.938667 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1e1b58f-e1c0-488e-b08e-44b9c6035f76 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:46.945882 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-12d16820-b767-4b86-a292-b1af10a4b0c2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:46.946598 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-12d16820-b767-4b86-a292-b1af10a4b0c2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:46.955153 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12d16820-b767-4b86-a292-b1af10a4b0c2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:46.955606 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12d16820-b767-4b86-a292-b1af10a4b0c2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:46.956481 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12d16820-b767-4b86-a292-b1af10a4b0c2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:46.956890 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12d16820-b767-4b86-a292-b1af10a4b0c2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:47.042369 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c1e1b58f-e1c0-488e-b08e-44b9c6035f76 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 38181 microversion: 2.20 time: 0.122139 Dec 15 14:21:47.048635 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 912/1736] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:46 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 38181 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:47.114862 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-12d16820-b767-4b86-a292-b1af10a4b0c2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:47.130773 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-12d16820-b767-4b86-a292-b1af10a4b0c2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.189689 Dec 15 14:21:47.131722 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 825/1737] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:46 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:47.822203 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c139bcfb-40b6-4e33-bac2-d23520fb83fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:47.822903 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c139bcfb-40b6-4e33-bac2-d23520fb83fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:47.830671 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c139bcfb-40b6-4e33-bac2-d23520fb83fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:47.831119 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c139bcfb-40b6-4e33-bac2-d23520fb83fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:47.831930 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c139bcfb-40b6-4e33-bac2-d23520fb83fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:47.832358 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c139bcfb-40b6-4e33-bac2-d23520fb83fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:47.984745 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c139bcfb-40b6-4e33-bac2-d23520fb83fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:47.995405 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c139bcfb-40b6-4e33-bac2-d23520fb83fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.177411 Dec 15 14:21:47.996082 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 913/1738] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:47 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:48.059423 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-20d90cba-7386-45d1-81a5-d6ba5589c77b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:48.060295 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-20d90cba-7386-45d1-81a5-d6ba5589c77b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:48.068708 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20d90cba-7386-45d1-81a5-d6ba5589c77b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:48.069162 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20d90cba-7386-45d1-81a5-d6ba5589c77b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:48.069993 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20d90cba-7386-45d1-81a5-d6ba5589c77b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:48.070424 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20d90cba-7386-45d1-81a5-d6ba5589c77b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:48.149209 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1ad43ba1-fdf5-42a8-b48f-b097e3f6bc0a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:48.149451 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-20d90cba-7386-45d1-81a5-d6ba5589c77b tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 38181 microversion: 2.20 time: 0.095170 Dec 15 14:21:48.149854 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1ad43ba1-fdf5-42a8-b48f-b097e3f6bc0a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:48.150824 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 826/1739] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:48 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 38181 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:48.157721 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ad43ba1-fdf5-42a8-b48f-b097e3f6bc0a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:48.158202 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ad43ba1-fdf5-42a8-b48f-b097e3f6bc0a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:48.158973 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ad43ba1-fdf5-42a8-b48f-b097e3f6bc0a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:48.159765 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ad43ba1-fdf5-42a8-b48f-b097e3f6bc0a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:48.307450 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1ad43ba1-fdf5-42a8-b48f-b097e3f6bc0a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:48.317410 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1ad43ba1-fdf5-42a8-b48f-b097e3f6bc0a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.172354 Dec 15 14:21:48.317973 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 914/1740] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:48 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:49.014860 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-195e15e0-9867-4391-acfb-e98bb5bc9a1b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:49.015538 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-195e15e0-9867-4391-acfb-e98bb5bc9a1b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:49.023476 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-195e15e0-9867-4391-acfb-e98bb5bc9a1b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:49.023919 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-195e15e0-9867-4391-acfb-e98bb5bc9a1b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:49.024711 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-195e15e0-9867-4391-acfb-e98bb5bc9a1b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:49.025142 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-195e15e0-9867-4391-acfb-e98bb5bc9a1b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:49.162348 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-82707256-d313-45ad-92f4-c7cea4f5781e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:49.163307 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-82707256-d313-45ad-92f4-c7cea4f5781e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:49.171495 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-82707256-d313-45ad-92f4-c7cea4f5781e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:49.171999 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-82707256-d313-45ad-92f4-c7cea4f5781e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:49.173058 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-82707256-d313-45ad-92f4-c7cea4f5781e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:49.173481 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-82707256-d313-45ad-92f4-c7cea4f5781e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:49.179467 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-195e15e0-9867-4391-acfb-e98bb5bc9a1b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:49.187212 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-195e15e0-9867-4391-acfb-e98bb5bc9a1b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.176558 Dec 15 14:21:49.188641 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 827/1741] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:49 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:49.260664 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-82707256-d313-45ad-92f4-c7cea4f5781e tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 38181 microversion: 2.20 time: 0.101906 Dec 15 14:21:49.261340 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 915/1742] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:49 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 38181 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:21:49.337421 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fae56ef3-6906-4611-8fb1-d19257150990 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:49.338335 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fae56ef3-6906-4611-8fb1-d19257150990 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:49.347149 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fae56ef3-6906-4611-8fb1-d19257150990 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:49.347518 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fae56ef3-6906-4611-8fb1-d19257150990 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:49.348313 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fae56ef3-6906-4611-8fb1-d19257150990 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:49.348742 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fae56ef3-6906-4611-8fb1-d19257150990 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:49.507271 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fae56ef3-6906-4611-8fb1-d19257150990 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:49.516109 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fae56ef3-6906-4611-8fb1-d19257150990 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.184069 Dec 15 14:21:49.517679 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 828/1743] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:49 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:50.209419 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7d8bab64-3fd0-4d50-a355-c6212e01a5e3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:50.210188 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7d8bab64-3fd0-4d50-a355-c6212e01a5e3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:50.219032 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7d8bab64-3fd0-4d50-a355-c6212e01a5e3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:50.219487 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7d8bab64-3fd0-4d50-a355-c6212e01a5e3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:50.220275 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7d8bab64-3fd0-4d50-a355-c6212e01a5e3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:50.220816 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7d8bab64-3fd0-4d50-a355-c6212e01a5e3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:50.276504 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7e98470c-2356-4b75-a624-56080f2e834c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:50.278046 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7e98470c-2356-4b75-a624-56080f2e834c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:50.287402 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7e98470c-2356-4b75-a624-56080f2e834c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:50.287857 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7e98470c-2356-4b75-a624-56080f2e834c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:50.288656 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7e98470c-2356-4b75-a624-56080f2e834c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:50.289090 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7e98470c-2356-4b75-a624-56080f2e834c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:50.375010 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7e98470c-2356-4b75-a624-56080f2e834c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action" status: 200 len: 38324 microversion: 2.20 time: 0.105310 Dec 15 14:21:50.375956 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 829/1744] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Dec 15 14:21:50 2021] POST /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/action => generated 38324 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:50.378737 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7d8bab64-3fd0-4d50-a355-c6212e01a5e3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:50.386237 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-36a31990-446f-4a06-b8e9-0a86b7d2e478 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:50.386780 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7d8bab64-3fd0-4d50-a355-c6212e01a5e3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.183768 Dec 15 14:21:50.386978 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-36a31990-446f-4a06-b8e9-0a86b7d2e478 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:50.387369 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 916/1745] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:50 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:50.394975 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36a31990-446f-4a06-b8e9-0a86b7d2e478 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:50.395403 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36a31990-446f-4a06-b8e9-0a86b7d2e478 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:50.396175 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36a31990-446f-4a06-b8e9-0a86b7d2e478 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:50.396602 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36a31990-446f-4a06-b8e9-0a86b7d2e478 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:50.421483 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-36a31990-446f-4a06-b8e9-0a86b7d2e478 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/ips" status: 200 len: 151 microversion: 2.20 time: 0.039201 Dec 15 14:21:50.422121 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 830/1746] 10.222.0.42 () {60 vars in 1288 bytes} [Wed Dec 15 14:21:50 2021] GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:21:50.534758 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-02ffe6f9-681a-4fd1-a2ee-aaa98955c146 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:50.535360 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-02ffe6f9-681a-4fd1-a2ee-aaa98955c146 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:50.545194 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-02ffe6f9-681a-4fd1-a2ee-aaa98955c146 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:50.545775 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-02ffe6f9-681a-4fd1-a2ee-aaa98955c146 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:50.546977 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-02ffe6f9-681a-4fd1-a2ee-aaa98955c146 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:50.547650 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-02ffe6f9-681a-4fd1-a2ee-aaa98955c146 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:50.703507 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-02ffe6f9-681a-4fd1-a2ee-aaa98955c146 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:50.712275 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-02ffe6f9-681a-4fd1-a2ee-aaa98955c146 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.182419 Dec 15 14:21:50.712860 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 917/1747] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:50 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:51.404595 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-20e52508-acb3-4aee-8ff8-0f91fd7e3659 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:51.405315 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-20e52508-acb3-4aee-8ff8-0f91fd7e3659 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:51.414343 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20e52508-acb3-4aee-8ff8-0f91fd7e3659 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:51.414930 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20e52508-acb3-4aee-8ff8-0f91fd7e3659 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:51.416159 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20e52508-acb3-4aee-8ff8-0f91fd7e3659 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:51.416840 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20e52508-acb3-4aee-8ff8-0f91fd7e3659 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:51.570891 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-20e52508-acb3-4aee-8ff8-0f91fd7e3659 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:51.579752 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-20e52508-acb3-4aee-8ff8-0f91fd7e3659 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.178969 Dec 15 14:21:51.580390 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 831/1748] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:51 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:51.730135 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2b0a516a-ace8-47c2-a93a-c66eb1426c55 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:51.730715 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2b0a516a-ace8-47c2-a93a-c66eb1426c55 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:51.737631 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b0a516a-ace8-47c2-a93a-c66eb1426c55 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:51.738302 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b0a516a-ace8-47c2-a93a-c66eb1426c55 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:51.739133 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b0a516a-ace8-47c2-a93a-c66eb1426c55 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:51.739578 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b0a516a-ace8-47c2-a93a-c66eb1426c55 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:51.893506 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2b0a516a-ace8-47c2-a93a-c66eb1426c55 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:51.902854 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2b0a516a-ace8-47c2-a93a-c66eb1426c55 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.176585 Dec 15 14:21:51.903595 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 918/1749] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:51 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:52.599470 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-edd1dc7a-0f7a-442e-8403-d4bd3e110b78 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:52.600159 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-edd1dc7a-0f7a-442e-8403-d4bd3e110b78 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:52.607092 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-edd1dc7a-0f7a-442e-8403-d4bd3e110b78 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:52.607587 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-edd1dc7a-0f7a-442e-8403-d4bd3e110b78 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:52.608395 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-edd1dc7a-0f7a-442e-8403-d4bd3e110b78 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:52.608836 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-edd1dc7a-0f7a-442e-8403-d4bd3e110b78 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:52.759632 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-edd1dc7a-0f7a-442e-8403-d4bd3e110b78 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:52.769020 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-edd1dc7a-0f7a-442e-8403-d4bd3e110b78 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.173152 Dec 15 14:21:52.769705 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 832/1750] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:52 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:52.920551 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-096ed5e0-b901-4a1c-b0e0-2646be91301f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:52.921190 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-096ed5e0-b901-4a1c-b0e0-2646be91301f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:52.929332 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-096ed5e0-b901-4a1c-b0e0-2646be91301f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:52.930069 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-096ed5e0-b901-4a1c-b0e0-2646be91301f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:52.931057 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-096ed5e0-b901-4a1c-b0e0-2646be91301f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:52.931487 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-096ed5e0-b901-4a1c-b0e0-2646be91301f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:53.078930 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-096ed5e0-b901-4a1c-b0e0-2646be91301f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:53.087917 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-096ed5e0-b901-4a1c-b0e0-2646be91301f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.171080 Dec 15 14:21:53.093627 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 919/1751] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:52 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:53.788306 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6eafdd35-67ba-4632-a233-fc3165662418 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:53.788869 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6eafdd35-67ba-4632-a233-fc3165662418 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:53.795685 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6eafdd35-67ba-4632-a233-fc3165662418 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:53.796122 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6eafdd35-67ba-4632-a233-fc3165662418 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:53.796918 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6eafdd35-67ba-4632-a233-fc3165662418 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:53.797349 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6eafdd35-67ba-4632-a233-fc3165662418 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:54.105295 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4efa4e87-02d2-4e6a-ae7b-2cb88607326a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:54.106159 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4efa4e87-02d2-4e6a-ae7b-2cb88607326a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:54.114163 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4efa4e87-02d2-4e6a-ae7b-2cb88607326a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:54.114601 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4efa4e87-02d2-4e6a-ae7b-2cb88607326a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:54.115392 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4efa4e87-02d2-4e6a-ae7b-2cb88607326a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:54.115822 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4efa4e87-02d2-4e6a-ae7b-2cb88607326a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:54.242956 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6eafdd35-67ba-4632-a233-fc3165662418 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:54.251056 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6eafdd35-67ba-4632-a233-fc3165662418 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.467048 Dec 15 14:21:54.251659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 833/1752] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:53 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:54.295702 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4efa4e87-02d2-4e6a-ae7b-2cb88607326a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:54.304077 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4efa4e87-02d2-4e6a-ae7b-2cb88607326a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.202765 Dec 15 14:21:54.304693 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 920/1753] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:54 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:55.269762 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-828f841d-ba4f-40bd-88c8-67c25b1cad10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:55.270418 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-828f841d-ba4f-40bd-88c8-67c25b1cad10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:55.277289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-828f841d-ba4f-40bd-88c8-67c25b1cad10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:55.277690 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-828f841d-ba4f-40bd-88c8-67c25b1cad10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:55.278330 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-828f841d-ba4f-40bd-88c8-67c25b1cad10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:55.278743 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-828f841d-ba4f-40bd-88c8-67c25b1cad10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:55.321688 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a1da2850-dcd6-4d6f-876f-d8795b63b058 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:55.322475 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a1da2850-dcd6-4d6f-876f-d8795b63b058 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:55.330315 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a1da2850-dcd6-4d6f-876f-d8795b63b058 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:55.330759 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a1da2850-dcd6-4d6f-876f-d8795b63b058 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:55.332069 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a1da2850-dcd6-4d6f-876f-d8795b63b058 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:55.332736 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a1da2850-dcd6-4d6f-876f-d8795b63b058 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:55.469751 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-828f841d-ba4f-40bd-88c8-67c25b1cad10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:55.479085 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-828f841d-ba4f-40bd-88c8-67c25b1cad10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.214145 Dec 15 14:21:55.479720 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 834/1754] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:55 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:55.520992 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a1da2850-dcd6-4d6f-876f-d8795b63b058 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:55.529154 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a1da2850-dcd6-4d6f-876f-d8795b63b058 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.211261 Dec 15 14:21:55.529766 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 921/1755] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:55 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:56.497138 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-68bacf6c-962f-4cef-b479-84a7c48f4be6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:56.498005 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-68bacf6c-962f-4cef-b479-84a7c48f4be6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:56.505129 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68bacf6c-962f-4cef-b479-84a7c48f4be6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:56.505570 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68bacf6c-962f-4cef-b479-84a7c48f4be6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:56.506394 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68bacf6c-962f-4cef-b479-84a7c48f4be6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:56.506901 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68bacf6c-962f-4cef-b479-84a7c48f4be6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:56.548533 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e9801be6-42c9-42f6-8c8c-f645d8d5f228 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:56.549160 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e9801be6-42c9-42f6-8c8c-f645d8d5f228 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:56.557645 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9801be6-42c9-42f6-8c8c-f645d8d5f228 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:56.558100 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9801be6-42c9-42f6-8c8c-f645d8d5f228 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:56.558941 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9801be6-42c9-42f6-8c8c-f645d8d5f228 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:56.559382 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9801be6-42c9-42f6-8c8c-f645d8d5f228 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:56.697563 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-68bacf6c-962f-4cef-b479-84a7c48f4be6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:56.707436 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-68bacf6c-962f-4cef-b479-84a7c48f4be6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.213876 Dec 15 14:21:56.708062 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 835/1756] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:56 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:21:56.753879 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e9801be6-42c9-42f6-8c8c-f645d8d5f228 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:56.763351 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e9801be6-42c9-42f6-8c8c-f645d8d5f228 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.218578 Dec 15 14:21:56.764054 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 922/1757] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:56 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:21:57.726173 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9072cf2c-68b0-40f5-891f-c411c101f5d6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:57.726767 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9072cf2c-68b0-40f5-891f-c411c101f5d6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:57.733456 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9072cf2c-68b0-40f5-891f-c411c101f5d6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:57.733940 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9072cf2c-68b0-40f5-891f-c411c101f5d6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:57.734792 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9072cf2c-68b0-40f5-891f-c411c101f5d6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:57.735236 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9072cf2c-68b0-40f5-891f-c411c101f5d6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:57.780448 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-42092a1a-16b5-42bc-b575-46e365389b71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:57.781149 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-42092a1a-16b5-42bc-b575-46e365389b71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:57.788566 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42092a1a-16b5-42bc-b575-46e365389b71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:57.789109 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42092a1a-16b5-42bc-b575-46e365389b71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:57.790018 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42092a1a-16b5-42bc-b575-46e365389b71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:57.790521 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42092a1a-16b5-42bc-b575-46e365389b71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:57.926043 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9072cf2c-68b0-40f5-891f-c411c101f5d6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:57.934495 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9072cf2c-68b0-40f5-891f-c411c101f5d6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.212388 Dec 15 14:21:57.935076 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 836/1758] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:57 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:57.972951 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-42092a1a-16b5-42bc-b575-46e365389b71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:57.981537 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-42092a1a-16b5-42bc-b575-46e365389b71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.204897 Dec 15 14:21:57.982125 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 923/1759] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:57 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:21:58.952095 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d54ac56a-6b24-4a20-905d-09c6ec09c9ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:58.952799 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d54ac56a-6b24-4a20-905d-09c6ec09c9ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:58.960994 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d54ac56a-6b24-4a20-905d-09c6ec09c9ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:58.961468 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d54ac56a-6b24-4a20-905d-09c6ec09c9ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:58.962313 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d54ac56a-6b24-4a20-905d-09c6ec09c9ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:58.962761 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d54ac56a-6b24-4a20-905d-09c6ec09c9ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:58.999056 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9cbd9cbc-bcc0-417d-8253-76326372b1b6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:58.999810 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9cbd9cbc-bcc0-417d-8253-76326372b1b6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:59.007396 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9cbd9cbc-bcc0-417d-8253-76326372b1b6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:59.007848 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9cbd9cbc-bcc0-417d-8253-76326372b1b6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:59.008649 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9cbd9cbc-bcc0-417d-8253-76326372b1b6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:59.009089 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9cbd9cbc-bcc0-417d-8253-76326372b1b6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:59.166337 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d54ac56a-6b24-4a20-905d-09c6ec09c9ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:59.174436 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d54ac56a-6b24-4a20-905d-09c6ec09c9ce tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.226515 Dec 15 14:21:59.175009 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 837/1760] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:58 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:59.216753 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9cbd9cbc-bcc0-417d-8253-76326372b1b6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:59.226948 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9cbd9cbc-bcc0-417d-8253-76326372b1b6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.231626 Dec 15 14:21:59.227531 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 924/1761] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:58 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:22:00.192900 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2ed6de18-7e28-4e2c-976a-a9b93809eaa4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:00.193527 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2ed6de18-7e28-4e2c-976a-a9b93809eaa4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:00.203973 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ed6de18-7e28-4e2c-976a-a9b93809eaa4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:00.204415 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ed6de18-7e28-4e2c-976a-a9b93809eaa4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:00.205192 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ed6de18-7e28-4e2c-976a-a9b93809eaa4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:00.205642 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ed6de18-7e28-4e2c-976a-a9b93809eaa4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:00.244851 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3d7a250b-a4b7-42da-bbae-11e9d12a9665 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:00.245489 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3d7a250b-a4b7-42da-bbae-11e9d12a9665 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:00.252755 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d7a250b-a4b7-42da-bbae-11e9d12a9665 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:00.253203 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d7a250b-a4b7-42da-bbae-11e9d12a9665 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:00.254136 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d7a250b-a4b7-42da-bbae-11e9d12a9665 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:00.254573 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d7a250b-a4b7-42da-bbae-11e9d12a9665 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:00.427220 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3d7a250b-a4b7-42da-bbae-11e9d12a9665 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:00.435550 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3d7a250b-a4b7-42da-bbae-11e9d12a9665 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.194649 Dec 15 14:22:00.436327 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 925/1762] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:00 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:00.526115 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2ed6de18-7e28-4e2c-976a-a9b93809eaa4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:00.534595 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2ed6de18-7e28-4e2c-976a-a9b93809eaa4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.345430 Dec 15 14:22:00.535244 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 838/1763] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:00 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:01.453309 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8dc0132d-ed00-40d4-b2b5-1e8f88e84c2f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:01.453948 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8dc0132d-ed00-40d4-b2b5-1e8f88e84c2f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:01.461159 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8dc0132d-ed00-40d4-b2b5-1e8f88e84c2f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:01.461635 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8dc0132d-ed00-40d4-b2b5-1e8f88e84c2f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:01.462419 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8dc0132d-ed00-40d4-b2b5-1e8f88e84c2f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:01.462865 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8dc0132d-ed00-40d4-b2b5-1e8f88e84c2f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:01.552734 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b089dab9-b7ef-4550-a0ae-f7d4df9683de tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:01.553445 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b089dab9-b7ef-4550-a0ae-f7d4df9683de tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:01.560893 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b089dab9-b7ef-4550-a0ae-f7d4df9683de tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:01.561342 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b089dab9-b7ef-4550-a0ae-f7d4df9683de tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:01.562163 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b089dab9-b7ef-4550-a0ae-f7d4df9683de tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:01.562598 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b089dab9-b7ef-4550-a0ae-f7d4df9683de tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:01.623641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8dc0132d-ed00-40d4-b2b5-1e8f88e84c2f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:01.631923 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8dc0132d-ed00-40d4-b2b5-1e8f88e84c2f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.182676 Dec 15 14:22:01.632524 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 926/1764] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:01 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:01.720577 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b089dab9-b7ef-4550-a0ae-f7d4df9683de tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:01.728516 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b089dab9-b7ef-4550-a0ae-f7d4df9683de tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.180113 Dec 15 14:22:01.729241 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 839/1765] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:01 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:02.651958 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e19b619b-b14d-4665-8c55-9e6bdfd0f768 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:02.652822 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e19b619b-b14d-4665-8c55-9e6bdfd0f768 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:02.661332 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e19b619b-b14d-4665-8c55-9e6bdfd0f768 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:02.662064 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e19b619b-b14d-4665-8c55-9e6bdfd0f768 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:02.663281 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e19b619b-b14d-4665-8c55-9e6bdfd0f768 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:02.664055 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e19b619b-b14d-4665-8c55-9e6bdfd0f768 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:02.747357 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-76fdecd6-eb19-4344-8e51-b6b43259042d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:02.748629 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-76fdecd6-eb19-4344-8e51-b6b43259042d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:02.755979 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-76fdecd6-eb19-4344-8e51-b6b43259042d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:02.756504 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-76fdecd6-eb19-4344-8e51-b6b43259042d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:02.757293 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-76fdecd6-eb19-4344-8e51-b6b43259042d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:02.757793 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-76fdecd6-eb19-4344-8e51-b6b43259042d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:02.847165 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e19b619b-b14d-4665-8c55-9e6bdfd0f768 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:02.858537 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e19b619b-b14d-4665-8c55-9e6bdfd0f768 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.212001 Dec 15 14:22:02.859496 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 927/1766] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:02 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:02.960237 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-76fdecd6-eb19-4344-8e51-b6b43259042d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:02.970106 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-76fdecd6-eb19-4344-8e51-b6b43259042d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.226718 Dec 15 14:22:02.970684 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 840/1767] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:02 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:03.878404 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8fecb2d4-c184-467b-99be-3620121756dd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:03.879092 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8fecb2d4-c184-467b-99be-3620121756dd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:03.886234 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8fecb2d4-c184-467b-99be-3620121756dd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:03.886690 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8fecb2d4-c184-467b-99be-3620121756dd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:03.887492 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8fecb2d4-c184-467b-99be-3620121756dd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:03.887936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8fecb2d4-c184-467b-99be-3620121756dd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:03.988606 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3ecef7e3-fabc-48f9-bacf-61b078c55f84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:03.989208 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3ecef7e3-fabc-48f9-bacf-61b078c55f84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:03.996695 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ecef7e3-fabc-48f9-bacf-61b078c55f84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:03.997154 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ecef7e3-fabc-48f9-bacf-61b078c55f84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:03.998019 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ecef7e3-fabc-48f9-bacf-61b078c55f84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:03.998471 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ecef7e3-fabc-48f9-bacf-61b078c55f84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:04.058392 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8fecb2d4-c184-467b-99be-3620121756dd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:04.066689 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8fecb2d4-c184-467b-99be-3620121756dd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.192414 Dec 15 14:22:04.067294 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 928/1768] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:03 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:04.165361 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3ecef7e3-fabc-48f9-bacf-61b078c55f84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:04.176747 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3ecef7e3-fabc-48f9-bacf-61b078c55f84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.191541 Dec 15 14:22:04.177778 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 841/1769] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:03 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:05.085504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3d03ef02-45d4-499f-88cc-e0d9231dd612 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:05.086155 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3d03ef02-45d4-499f-88cc-e0d9231dd612 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:05.093238 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d03ef02-45d4-499f-88cc-e0d9231dd612 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:05.093727 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d03ef02-45d4-499f-88cc-e0d9231dd612 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:05.094532 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d03ef02-45d4-499f-88cc-e0d9231dd612 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:05.094969 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d03ef02-45d4-499f-88cc-e0d9231dd612 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:05.193937 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c3391fd7-e0e5-41b1-ae6e-dfd649614f81 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:05.194549 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c3391fd7-e0e5-41b1-ae6e-dfd649614f81 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:05.202020 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3391fd7-e0e5-41b1-ae6e-dfd649614f81 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:05.202505 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3391fd7-e0e5-41b1-ae6e-dfd649614f81 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:05.203306 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3391fd7-e0e5-41b1-ae6e-dfd649614f81 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:05.203770 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3391fd7-e0e5-41b1-ae6e-dfd649614f81 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:05.261640 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3d03ef02-45d4-499f-88cc-e0d9231dd612 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:05.270048 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3d03ef02-45d4-499f-88cc-e0d9231dd612 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.188768 Dec 15 14:22:05.270613 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 929/1770] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:05 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:05.368248 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c3391fd7-e0e5-41b1-ae6e-dfd649614f81 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:05.380247 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c3391fd7-e0e5-41b1-ae6e-dfd649614f81 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.189747 Dec 15 14:22:05.381156 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 842/1771] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:05 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:22:06.290101 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-12030632-4fd1-4247-8b0c-448b4acba5ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:06.290825 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-12030632-4fd1-4247-8b0c-448b4acba5ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:06.299586 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12030632-4fd1-4247-8b0c-448b4acba5ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:06.300349 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12030632-4fd1-4247-8b0c-448b4acba5ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:06.301687 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12030632-4fd1-4247-8b0c-448b4acba5ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:06.303181 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12030632-4fd1-4247-8b0c-448b4acba5ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:06.400153 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-57e39b54-772c-4db3-8772-e1e34bc980b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:06.400815 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-57e39b54-772c-4db3-8772-e1e34bc980b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:06.410034 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57e39b54-772c-4db3-8772-e1e34bc980b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:06.410475 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57e39b54-772c-4db3-8772-e1e34bc980b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:06.411294 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57e39b54-772c-4db3-8772-e1e34bc980b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:06.411874 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57e39b54-772c-4db3-8772-e1e34bc980b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:06.476121 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-12030632-4fd1-4247-8b0c-448b4acba5ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:06.485925 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-12030632-4fd1-4247-8b0c-448b4acba5ac tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.200909 Dec 15 14:22:06.486514 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 930/1772] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:06 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:06.584361 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-57e39b54-772c-4db3-8772-e1e34bc980b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:06.595793 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-57e39b54-772c-4db3-8772-e1e34bc980b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.200780 Dec 15 14:22:06.596555 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 843/1773] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:06 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:07.504386 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3571e9b5-201c-40df-b7dd-8cff45d59f00 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:07.505206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3571e9b5-201c-40df-b7dd-8cff45d59f00 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:07.511776 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3571e9b5-201c-40df-b7dd-8cff45d59f00 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:07.512222 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3571e9b5-201c-40df-b7dd-8cff45d59f00 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:07.513032 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3571e9b5-201c-40df-b7dd-8cff45d59f00 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:07.513482 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3571e9b5-201c-40df-b7dd-8cff45d59f00 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:07.615541 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fe7bc6e0-8a48-4562-a463-a177e0ce6e6f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:07.615541 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fe7bc6e0-8a48-4562-a463-a177e0ce6e6f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:07.624101 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe7bc6e0-8a48-4562-a463-a177e0ce6e6f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:07.624780 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe7bc6e0-8a48-4562-a463-a177e0ce6e6f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:07.626168 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe7bc6e0-8a48-4562-a463-a177e0ce6e6f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:07.626873 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe7bc6e0-8a48-4562-a463-a177e0ce6e6f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:07.684411 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3571e9b5-201c-40df-b7dd-8cff45d59f00 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:07.693358 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3571e9b5-201c-40df-b7dd-8cff45d59f00 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.193024 Dec 15 14:22:07.694016 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 931/1774] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:07 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:07.786442 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fe7bc6e0-8a48-4562-a463-a177e0ce6e6f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:07.795472 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fe7bc6e0-8a48-4562-a463-a177e0ce6e6f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.185440 Dec 15 14:22:07.796044 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 844/1775] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:07 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:08.713787 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6c4d95f1-9432-4b33-8223-e90c888d6faa tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:08.714375 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6c4d95f1-9432-4b33-8223-e90c888d6faa tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:08.721729 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c4d95f1-9432-4b33-8223-e90c888d6faa tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:08.722186 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c4d95f1-9432-4b33-8223-e90c888d6faa tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:08.723084 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c4d95f1-9432-4b33-8223-e90c888d6faa tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:08.723518 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c4d95f1-9432-4b33-8223-e90c888d6faa tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:08.813636 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-12461f3e-d784-4cce-857d-dcd330cda742 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:08.814235 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-12461f3e-d784-4cce-857d-dcd330cda742 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:08.824298 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12461f3e-d784-4cce-857d-dcd330cda742 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:08.825087 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12461f3e-d784-4cce-857d-dcd330cda742 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:08.826909 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12461f3e-d784-4cce-857d-dcd330cda742 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:08.827692 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12461f3e-d784-4cce-857d-dcd330cda742 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:08.909126 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6c4d95f1-9432-4b33-8223-e90c888d6faa tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:08.921289 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6c4d95f1-9432-4b33-8223-e90c888d6faa tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.212238 Dec 15 14:22:08.922179 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 932/1776] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:08 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:09.013329 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-12461f3e-d784-4cce-857d-dcd330cda742 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:09.022209 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-12461f3e-d784-4cce-857d-dcd330cda742 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.212277 Dec 15 14:22:09.023116 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 845/1777] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:08 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:22:09.939966 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bf8ce08d-bc71-4cbe-9fce-fc3e277440e9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:09.940660 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bf8ce08d-bc71-4cbe-9fce-fc3e277440e9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:09.949422 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bf8ce08d-bc71-4cbe-9fce-fc3e277440e9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:09.950170 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bf8ce08d-bc71-4cbe-9fce-fc3e277440e9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:09.951684 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bf8ce08d-bc71-4cbe-9fce-fc3e277440e9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:09.952385 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bf8ce08d-bc71-4cbe-9fce-fc3e277440e9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:10.040103 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9fec5f2f-cb69-47a0-a5cf-c0a219b78b6f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:10.040690 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9fec5f2f-cb69-47a0-a5cf-c0a219b78b6f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:10.047615 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fec5f2f-cb69-47a0-a5cf-c0a219b78b6f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:10.048051 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fec5f2f-cb69-47a0-a5cf-c0a219b78b6f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:10.048859 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fec5f2f-cb69-47a0-a5cf-c0a219b78b6f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:10.049297 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fec5f2f-cb69-47a0-a5cf-c0a219b78b6f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:10.149839 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bf8ce08d-bc71-4cbe-9fce-fc3e277440e9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:10.158360 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bf8ce08d-bc71-4cbe-9fce-fc3e277440e9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.222158 Dec 15 14:22:10.158937 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 933/1778] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:09 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:10.229025 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9fec5f2f-cb69-47a0-a5cf-c0a219b78b6f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:10.238848 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9fec5f2f-cb69-47a0-a5cf-c0a219b78b6f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.202622 Dec 15 14:22:10.239439 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 846/1779] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:10 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:22:11.176688 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c898ce47-1da9-4e62-b5aa-ade0fa2622b7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:11.177314 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c898ce47-1da9-4e62-b5aa-ade0fa2622b7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:11.185728 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c898ce47-1da9-4e62-b5aa-ade0fa2622b7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:11.186436 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c898ce47-1da9-4e62-b5aa-ade0fa2622b7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:11.187063 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c898ce47-1da9-4e62-b5aa-ade0fa2622b7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:11.187558 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c898ce47-1da9-4e62-b5aa-ade0fa2622b7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:11.259563 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-449ff203-8e17-4a8b-ac4e-e21181d89e86 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:11.260240 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-449ff203-8e17-4a8b-ac4e-e21181d89e86 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:11.267386 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-449ff203-8e17-4a8b-ac4e-e21181d89e86 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:11.267826 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-449ff203-8e17-4a8b-ac4e-e21181d89e86 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:11.268625 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-449ff203-8e17-4a8b-ac4e-e21181d89e86 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:11.269064 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-449ff203-8e17-4a8b-ac4e-e21181d89e86 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:11.369797 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c898ce47-1da9-4e62-b5aa-ade0fa2622b7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:11.378117 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c898ce47-1da9-4e62-b5aa-ade0fa2622b7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.205161 Dec 15 14:22:11.378721 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 934/1780] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:11 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:11.445021 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-449ff203-8e17-4a8b-ac4e-e21181d89e86 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:11.454347 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-449ff203-8e17-4a8b-ac4e-e21181d89e86 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.198203 Dec 15 14:22:11.454710 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 847/1781] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:11 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:12.399294 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-14c4f7fa-aa57-4925-accc-154f45230640 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:12.399924 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-14c4f7fa-aa57-4925-accc-154f45230640 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:12.406771 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-14c4f7fa-aa57-4925-accc-154f45230640 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:12.407219 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-14c4f7fa-aa57-4925-accc-154f45230640 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:12.408023 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-14c4f7fa-aa57-4925-accc-154f45230640 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:12.408459 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-14c4f7fa-aa57-4925-accc-154f45230640 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:12.471205 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-aa37e62c-61ca-4a11-addf-862277c2b8c4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:12.471868 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-aa37e62c-61ca-4a11-addf-862277c2b8c4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:12.479097 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa37e62c-61ca-4a11-addf-862277c2b8c4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:12.479555 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa37e62c-61ca-4a11-addf-862277c2b8c4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:12.480342 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa37e62c-61ca-4a11-addf-862277c2b8c4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:12.480769 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa37e62c-61ca-4a11-addf-862277c2b8c4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:12.589228 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-14c4f7fa-aa57-4925-accc-154f45230640 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:12.597946 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-14c4f7fa-aa57-4925-accc-154f45230640 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.204096 Dec 15 14:22:12.598780 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 935/1782] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:12 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:12.673109 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-aa37e62c-61ca-4a11-addf-862277c2b8c4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:12.682863 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-aa37e62c-61ca-4a11-addf-862277c2b8c4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.215548 Dec 15 14:22:12.683528 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 848/1783] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:12 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:13.616174 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-526d5cbf-d579-4542-bc98-468058aaf89b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:13.617128 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-526d5cbf-d579-4542-bc98-468058aaf89b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:13.624810 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-526d5cbf-d579-4542-bc98-468058aaf89b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:13.625255 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-526d5cbf-d579-4542-bc98-468058aaf89b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:13.626112 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-526d5cbf-d579-4542-bc98-468058aaf89b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:13.626546 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-526d5cbf-d579-4542-bc98-468058aaf89b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:13.701708 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dd61db88-1b1e-48b8-b1e6-95991fd4c52c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:13.702342 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dd61db88-1b1e-48b8-b1e6-95991fd4c52c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:13.709092 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd61db88-1b1e-48b8-b1e6-95991fd4c52c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:13.709477 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd61db88-1b1e-48b8-b1e6-95991fd4c52c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:13.710513 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd61db88-1b1e-48b8-b1e6-95991fd4c52c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:13.711137 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd61db88-1b1e-48b8-b1e6-95991fd4c52c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:13.811163 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-526d5cbf-d579-4542-bc98-468058aaf89b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:13.827352 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-526d5cbf-d579-4542-bc98-468058aaf89b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.215091 Dec 15 14:22:13.827967 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 936/1784] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:13 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:13.898140 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dd61db88-1b1e-48b8-b1e6-95991fd4c52c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:13.907344 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dd61db88-1b1e-48b8-b1e6-95991fd4c52c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.210411 Dec 15 14:22:13.907945 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 849/1785] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:13 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:14.856807 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1e389934-806e-4b05-b618-32127ba4e544 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:14.857431 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1e389934-806e-4b05-b618-32127ba4e544 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:14.864402 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e389934-806e-4b05-b618-32127ba4e544 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:14.864855 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e389934-806e-4b05-b618-32127ba4e544 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:14.865690 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e389934-806e-4b05-b618-32127ba4e544 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:14.866761 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e389934-806e-4b05-b618-32127ba4e544 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:14.925434 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-01bc2b2f-a08d-4afe-bce4-71c27f8ea32a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:14.926047 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-01bc2b2f-a08d-4afe-bce4-71c27f8ea32a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:14.934169 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01bc2b2f-a08d-4afe-bce4-71c27f8ea32a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:14.934720 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01bc2b2f-a08d-4afe-bce4-71c27f8ea32a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:14.935597 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01bc2b2f-a08d-4afe-bce4-71c27f8ea32a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:14.936037 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01bc2b2f-a08d-4afe-bce4-71c27f8ea32a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:15.050245 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1e389934-806e-4b05-b618-32127ba4e544 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:15.058936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1e389934-806e-4b05-b618-32127ba4e544 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.205902 Dec 15 14:22:15.059599 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 937/1786] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:14 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:15.118780 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-01bc2b2f-a08d-4afe-bce4-71c27f8ea32a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:15.127536 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-01bc2b2f-a08d-4afe-bce4-71c27f8ea32a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.205800 Dec 15 14:22:15.128124 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 850/1787] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:14 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:22:16.076888 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3f1e4822-4d32-4df6-a448-5a3fb66a8c78 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:16.077624 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3f1e4822-4d32-4df6-a448-5a3fb66a8c78 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:16.084419 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3f1e4822-4d32-4df6-a448-5a3fb66a8c78 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:16.085143 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3f1e4822-4d32-4df6-a448-5a3fb66a8c78 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:16.086063 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3f1e4822-4d32-4df6-a448-5a3fb66a8c78 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:16.086515 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3f1e4822-4d32-4df6-a448-5a3fb66a8c78 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:16.148582 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-949b4a5d-7e1f-4699-b91d-3dc4f75af764 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:16.149302 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-949b4a5d-7e1f-4699-b91d-3dc4f75af764 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:16.156296 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-949b4a5d-7e1f-4699-b91d-3dc4f75af764 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:16.156820 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-949b4a5d-7e1f-4699-b91d-3dc4f75af764 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:16.157676 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-949b4a5d-7e1f-4699-b91d-3dc4f75af764 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:16.158116 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-949b4a5d-7e1f-4699-b91d-3dc4f75af764 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:16.276304 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3f1e4822-4d32-4df6-a448-5a3fb66a8c78 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:16.284803 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3f1e4822-4d32-4df6-a448-5a3fb66a8c78 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.212068 Dec 15 14:22:16.285399 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 938/1788] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:16 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:16.348700 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-949b4a5d-7e1f-4699-b91d-3dc4f75af764 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:16.356525 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-949b4a5d-7e1f-4699-b91d-3dc4f75af764 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1450 microversion: 2.1 time: 0.211827 Dec 15 14:22:16.357102 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 851/1789] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:16 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1450 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:22:17.313508 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5ea3417f-1ac8-4b6f-8dc5-4376997dafff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:17.314174 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5ea3417f-1ac8-4b6f-8dc5-4376997dafff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:17.328165 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5ea3417f-1ac8-4b6f-8dc5-4376997dafff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:17.328637 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5ea3417f-1ac8-4b6f-8dc5-4376997dafff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:17.329453 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5ea3417f-1ac8-4b6f-8dc5-4376997dafff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:17.330126 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5ea3417f-1ac8-4b6f-8dc5-4376997dafff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:17.374539 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-62653493-841f-4aaf-afb0-43d0975ddebb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:17.379329 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-62653493-841f-4aaf-afb0-43d0975ddebb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:17.382775 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-62653493-841f-4aaf-afb0-43d0975ddebb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:17.383225 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-62653493-841f-4aaf-afb0-43d0975ddebb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:17.384031 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-62653493-841f-4aaf-afb0-43d0975ddebb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:17.384463 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-62653493-841f-4aaf-afb0-43d0975ddebb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:17.683697 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5ea3417f-1ac8-4b6f-8dc5-4376997dafff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:17.692456 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5ea3417f-1ac8-4b6f-8dc5-4376997dafff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.382398 Dec 15 14:22:17.704303 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 939/1790] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:17 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:17.734691 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-62653493-841f-4aaf-afb0-43d0975ddebb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:17.743506 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-62653493-841f-4aaf-afb0-43d0975ddebb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1444 microversion: 2.1 time: 0.372669 Dec 15 14:22:17.744095 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 852/1791] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:17 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1444 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:22:17.984300 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-50374cf3-4079-459a-8143-5e94cb28bf10 req-6d77a002-5521-46c2-8005-65d89c05e548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12be41af-387a-4090-93dd-d26d8e97bf45", "name": "network-vif-deleted", "tag": "ffe19195-444e-423e-ac6a-9120626e5ae8"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:22:17.986014 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:22:17.986014 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:22:17.994811 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-50374cf3-4079-459a-8143-5e94cb28bf10 req-6d77a002-5521-46c2-8005-65d89c05e548 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:17.995265 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-50374cf3-4079-459a-8143-5e94cb28bf10 req-6d77a002-5521-46c2-8005-65d89c05e548 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:18.008231 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-50374cf3-4079-459a-8143-5e94cb28bf10 req-6d77a002-5521-46c2-8005-65d89c05e548 service nova] Creating event network-vif-deleted:ffe19195-444e-423e-ac6a-9120626e5ae8 for instance 12be41af-387a-4090-93dd-d26d8e97bf45 on hv-cinder-82182 Dec 15 14:22:18.013437 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-50374cf3-4079-459a-8143-5e94cb28bf10 req-6d77a002-5521-46c2-8005-65d89c05e548 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107801 Dec 15 14:22:18.014375 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 940/1792] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:22:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:22:18.712099 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-22e35924-bbf4-4470-8bfc-8756cd9028dd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:18.712786 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-22e35924-bbf4-4470-8bfc-8756cd9028dd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:18.719929 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22e35924-bbf4-4470-8bfc-8756cd9028dd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:18.720379 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22e35924-bbf4-4470-8bfc-8756cd9028dd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:18.721180 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22e35924-bbf4-4470-8bfc-8756cd9028dd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:18.721637 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22e35924-bbf4-4470-8bfc-8756cd9028dd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:18.761808 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dd7b05b3-74fb-4fb8-bc0f-e76dc384f90b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:18.762560 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dd7b05b3-74fb-4fb8-bc0f-e76dc384f90b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:18.770190 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dd7b05b3-74fb-4fb8-bc0f-e76dc384f90b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:18.770640 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dd7b05b3-74fb-4fb8-bc0f-e76dc384f90b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:18.771466 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dd7b05b3-74fb-4fb8-bc0f-e76dc384f90b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:18.771898 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dd7b05b3-74fb-4fb8-bc0f-e76dc384f90b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:18.857666 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dd7b05b3-74fb-4fb8-bc0f-e76dc384f90b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:18.865867 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dd7b05b3-74fb-4fb8-bc0f-e76dc384f90b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.108889 Dec 15 14:22:18.866866 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 941/1793] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:18 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:18.905067 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-22e35924-bbf4-4470-8bfc-8756cd9028dd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:18.913787 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-22e35924-bbf4-4470-8bfc-8756cd9028dd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.205254 Dec 15 14:22:18.914525 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 853/1794] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:18 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:19.883640 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-aff3dc92-a684-4801-a5f4-9f992f560c95 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:19.884345 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-aff3dc92-a684-4801-a5f4-9f992f560c95 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:19.891573 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aff3dc92-a684-4801-a5f4-9f992f560c95 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:19.891994 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aff3dc92-a684-4801-a5f4-9f992f560c95 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:19.892783 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aff3dc92-a684-4801-a5f4-9f992f560c95 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:19.893215 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aff3dc92-a684-4801-a5f4-9f992f560c95 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:19.932854 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bfd81ed5-65b7-4705-b5a8-ae3884c85ad7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:19.933521 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bfd81ed5-65b7-4705-b5a8-ae3884c85ad7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:19.940026 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bfd81ed5-65b7-4705-b5a8-ae3884c85ad7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:19.940462 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bfd81ed5-65b7-4705-b5a8-ae3884c85ad7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:19.941223 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bfd81ed5-65b7-4705-b5a8-ae3884c85ad7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:19.941681 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bfd81ed5-65b7-4705-b5a8-ae3884c85ad7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:19.957569 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-aff3dc92-a684-4801-a5f4-9f992f560c95 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:19.966756 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-aff3dc92-a684-4801-a5f4-9f992f560c95 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.086863 Dec 15 14:22:19.967334 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 942/1795] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:19 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:20.094935 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bfd81ed5-65b7-4705-b5a8-ae3884c85ad7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:20.103927 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bfd81ed5-65b7-4705-b5a8-ae3884c85ad7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.174738 Dec 15 14:22:20.104762 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 854/1796] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:19 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:22:20.983890 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7767872e-427a-4285-b53f-92ee8450c3c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:20.984501 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7767872e-427a-4285-b53f-92ee8450c3c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:20.991241 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7767872e-427a-4285-b53f-92ee8450c3c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:20.991694 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7767872e-427a-4285-b53f-92ee8450c3c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:20.992474 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7767872e-427a-4285-b53f-92ee8450c3c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:20.992906 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7767872e-427a-4285-b53f-92ee8450c3c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:21.059569 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7767872e-427a-4285-b53f-92ee8450c3c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:21.067988 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7767872e-427a-4285-b53f-92ee8450c3c1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.087905 Dec 15 14:22:21.068583 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 943/1797] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:20 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:21.122269 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-01e92e51-b8ff-4fb8-803a-a3d63ab5987b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:21.122893 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-01e92e51-b8ff-4fb8-803a-a3d63ab5987b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:21.129493 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01e92e51-b8ff-4fb8-803a-a3d63ab5987b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:21.129980 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01e92e51-b8ff-4fb8-803a-a3d63ab5987b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:21.130776 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01e92e51-b8ff-4fb8-803a-a3d63ab5987b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:21.131218 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01e92e51-b8ff-4fb8-803a-a3d63ab5987b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:21.292206 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-01e92e51-b8ff-4fb8-803a-a3d63ab5987b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:21.300683 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-01e92e51-b8ff-4fb8-803a-a3d63ab5987b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.182230 Dec 15 14:22:21.301262 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 855/1798] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:21 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:22.086707 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f74b638b-dc64-42bb-97c2-2fe46c10acfe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:22.087314 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f74b638b-dc64-42bb-97c2-2fe46c10acfe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:22.093891 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f74b638b-dc64-42bb-97c2-2fe46c10acfe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:22.094484 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f74b638b-dc64-42bb-97c2-2fe46c10acfe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:22.095564 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f74b638b-dc64-42bb-97c2-2fe46c10acfe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:22.096006 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f74b638b-dc64-42bb-97c2-2fe46c10acfe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:22.159061 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f74b638b-dc64-42bb-97c2-2fe46c10acfe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:22.167038 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f74b638b-dc64-42bb-97c2-2fe46c10acfe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.084736 Dec 15 14:22:22.167603 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 944/1799] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:22 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:22.322082 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d26309e7-b312-411c-af20-f45bb73d2a23 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:22.322744 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d26309e7-b312-411c-af20-f45bb73d2a23 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:22.330362 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d26309e7-b312-411c-af20-f45bb73d2a23 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:22.330809 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d26309e7-b312-411c-af20-f45bb73d2a23 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:22.331607 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d26309e7-b312-411c-af20-f45bb73d2a23 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:22.332041 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d26309e7-b312-411c-af20-f45bb73d2a23 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:22.477647 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d26309e7-b312-411c-af20-f45bb73d2a23 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:22.487042 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d26309e7-b312-411c-af20-f45bb73d2a23 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.169195 Dec 15 14:22:22.487639 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 856/1800] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:22 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:23.184496 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5786a927-e56c-4c59-8292-bfb105f7063c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:23.185120 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5786a927-e56c-4c59-8292-bfb105f7063c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:23.194898 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5786a927-e56c-4c59-8292-bfb105f7063c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:23.194898 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5786a927-e56c-4c59-8292-bfb105f7063c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:23.196424 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5786a927-e56c-4c59-8292-bfb105f7063c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:23.196663 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5786a927-e56c-4c59-8292-bfb105f7063c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:23.266622 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5786a927-e56c-4c59-8292-bfb105f7063c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:23.276410 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5786a927-e56c-4c59-8292-bfb105f7063c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.095745 Dec 15 14:22:23.277003 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 945/1801] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:23 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:23.505847 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4d1a8fe1-fd11-4a03-85af-3e3e28ee18b3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:23.506457 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4d1a8fe1-fd11-4a03-85af-3e3e28ee18b3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:23.514035 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d1a8fe1-fd11-4a03-85af-3e3e28ee18b3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:23.514484 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d1a8fe1-fd11-4a03-85af-3e3e28ee18b3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:23.515289 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d1a8fe1-fd11-4a03-85af-3e3e28ee18b3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:23.515726 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d1a8fe1-fd11-4a03-85af-3e3e28ee18b3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:23.668188 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4d1a8fe1-fd11-4a03-85af-3e3e28ee18b3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:23.677958 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4d1a8fe1-fd11-4a03-85af-3e3e28ee18b3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.175957 Dec 15 14:22:23.678590 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 857/1802] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:23 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:24.293986 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-21749f5d-74a7-45c2-ba08-dcde1bafa295 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:24.294652 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-21749f5d-74a7-45c2-ba08-dcde1bafa295 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:24.301751 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21749f5d-74a7-45c2-ba08-dcde1bafa295 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:24.302207 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21749f5d-74a7-45c2-ba08-dcde1bafa295 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:24.303025 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21749f5d-74a7-45c2-ba08-dcde1bafa295 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:24.303465 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21749f5d-74a7-45c2-ba08-dcde1bafa295 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:24.382446 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-21749f5d-74a7-45c2-ba08-dcde1bafa295 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:24.391750 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-21749f5d-74a7-45c2-ba08-dcde1bafa295 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.101697 Dec 15 14:22:24.392341 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 946/1803] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:24 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:24.696621 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-30b9ea0f-fd47-4b41-a86d-dd54cd59bcb6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:24.697244 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-30b9ea0f-fd47-4b41-a86d-dd54cd59bcb6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:24.704822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30b9ea0f-fd47-4b41-a86d-dd54cd59bcb6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:24.705268 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30b9ea0f-fd47-4b41-a86d-dd54cd59bcb6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:24.706086 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30b9ea0f-fd47-4b41-a86d-dd54cd59bcb6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:24.706521 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30b9ea0f-fd47-4b41-a86d-dd54cd59bcb6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:24.867591 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-30b9ea0f-fd47-4b41-a86d-dd54cd59bcb6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:24.876159 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-30b9ea0f-fd47-4b41-a86d-dd54cd59bcb6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.183544 Dec 15 14:22:24.876734 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 858/1804] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:24 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:25.410140 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-67373721-618b-48c2-8747-8040e20cda72 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:25.410773 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-67373721-618b-48c2-8747-8040e20cda72 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:25.417644 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67373721-618b-48c2-8747-8040e20cda72 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:25.418097 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67373721-618b-48c2-8747-8040e20cda72 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:25.418895 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67373721-618b-48c2-8747-8040e20cda72 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:25.419339 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67373721-618b-48c2-8747-8040e20cda72 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:25.490000 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-67373721-618b-48c2-8747-8040e20cda72 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:25.500072 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-67373721-618b-48c2-8747-8040e20cda72 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.093633 Dec 15 14:22:25.500679 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 947/1805] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:25 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:25.893967 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0c48fd99-8704-4491-a20f-d8ce9015af41 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:25.894722 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0c48fd99-8704-4491-a20f-d8ce9015af41 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:25.901890 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0c48fd99-8704-4491-a20f-d8ce9015af41 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:25.902340 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0c48fd99-8704-4491-a20f-d8ce9015af41 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:25.903168 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0c48fd99-8704-4491-a20f-d8ce9015af41 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:25.903603 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0c48fd99-8704-4491-a20f-d8ce9015af41 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:26.071002 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0c48fd99-8704-4491-a20f-d8ce9015af41 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:26.079911 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0c48fd99-8704-4491-a20f-d8ce9015af41 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.189814 Dec 15 14:22:26.080494 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 859/1806] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:25 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:26.517732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9530d0fc-5958-4c3d-9d60-79fe38f14c32 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:26.518394 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9530d0fc-5958-4c3d-9d60-79fe38f14c32 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:26.526170 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9530d0fc-5958-4c3d-9d60-79fe38f14c32 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:26.526627 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9530d0fc-5958-4c3d-9d60-79fe38f14c32 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:26.527451 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9530d0fc-5958-4c3d-9d60-79fe38f14c32 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:26.527899 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9530d0fc-5958-4c3d-9d60-79fe38f14c32 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:26.600835 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9530d0fc-5958-4c3d-9d60-79fe38f14c32 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:26.609648 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9530d0fc-5958-4c3d-9d60-79fe38f14c32 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.095726 Dec 15 14:22:26.610312 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 948/1807] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:26 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:26.787105 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-103e1945-e6ec-4beb-b097-96ec00dec9a0 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:26.787686 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-103e1945-e6ec-4beb-b097-96ec00dec9a0 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:26.795031 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-103e1945-e6ec-4beb-b097-96ec00dec9a0 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:26.795645 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-103e1945-e6ec-4beb-b097-96ec00dec9a0 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:26.796504 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-103e1945-e6ec-4beb-b097-96ec00dec9a0 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:26.797003 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-103e1945-e6ec-4beb-b097-96ec00dec9a0 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:26.824442 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-103e1945-e6ec-4beb-b097-96ec00dec9a0 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:22:26.910002 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-103e1945-e6ec-4beb-b097-96ec00dec9a0 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "DELETE /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 204 len: 0 microversion: 2.1 time: 0.126781 Dec 15 14:22:26.910717 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 860/1808] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:22:26 2021] DELETE /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:22:26.919585 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8510e9bf-e8c7-4410-90e5-b8b234e8d172 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:26.920201 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8510e9bf-e8c7-4410-90e5-b8b234e8d172 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:26.926724 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8510e9bf-e8c7-4410-90e5-b8b234e8d172 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:26.927176 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8510e9bf-e8c7-4410-90e5-b8b234e8d172 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:26.927962 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8510e9bf-e8c7-4410-90e5-b8b234e8d172 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:26.928399 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8510e9bf-e8c7-4410-90e5-b8b234e8d172 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:27.073913 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8510e9bf-e8c7-4410-90e5-b8b234e8d172 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:27.082774 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8510e9bf-e8c7-4410-90e5-b8b234e8d172 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 200 len: 1555 microversion: 2.1 time: 0.166947 Dec 15 14:22:27.083345 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 949/1809] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:26 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:27.098792 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6bf317cb-3dde-4cd3-9633-5a019e2822dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:27.099466 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6bf317cb-3dde-4cd3-9633-5a019e2822dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:27.106259 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bf317cb-3dde-4cd3-9633-5a019e2822dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:27.106694 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bf317cb-3dde-4cd3-9633-5a019e2822dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:27.107486 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bf317cb-3dde-4cd3-9633-5a019e2822dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:27.107917 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bf317cb-3dde-4cd3-9633-5a019e2822dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:27.251998 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6bf317cb-3dde-4cd3-9633-5a019e2822dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:27.261759 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6bf317cb-3dde-4cd3-9633-5a019e2822dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.166953 Dec 15 14:22:27.262275 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 861/1810] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:27 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:27.627296 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-afaff81a-1020-4f47-a31e-0a35d660561c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:27.627928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-afaff81a-1020-4f47-a31e-0a35d660561c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:27.636520 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-afaff81a-1020-4f47-a31e-0a35d660561c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:27.636966 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-afaff81a-1020-4f47-a31e-0a35d660561c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:27.637813 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-afaff81a-1020-4f47-a31e-0a35d660561c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:27.638243 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-afaff81a-1020-4f47-a31e-0a35d660561c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:27.709720 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-afaff81a-1020-4f47-a31e-0a35d660561c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:27.727262 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-afaff81a-1020-4f47-a31e-0a35d660561c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.102362 Dec 15 14:22:27.728016 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 950/1811] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:27 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:28.102604 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9de8d913-a503-4fb5-9ed1-f9c3081c4119 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:28.103357 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9de8d913-a503-4fb5-9ed1-f9c3081c4119 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:28.110221 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9de8d913-a503-4fb5-9ed1-f9c3081c4119 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:28.110664 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9de8d913-a503-4fb5-9ed1-f9c3081c4119 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:28.111463 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9de8d913-a503-4fb5-9ed1-f9c3081c4119 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:28.111895 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9de8d913-a503-4fb5-9ed1-f9c3081c4119 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:28.280013 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-27e7dc9d-167f-4d35-b856-06daf6a3b965 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:28.280631 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-27e7dc9d-167f-4d35-b856-06daf6a3b965 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:28.286854 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-27e7dc9d-167f-4d35-b856-06daf6a3b965 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:28.287301 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-27e7dc9d-167f-4d35-b856-06daf6a3b965 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:28.288194 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-27e7dc9d-167f-4d35-b856-06daf6a3b965 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:28.288615 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-27e7dc9d-167f-4d35-b856-06daf6a3b965 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:28.415724 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9de8d913-a503-4fb5-9ed1-f9c3081c4119 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e174c52ded9449ebdea2ce7263c8038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192905d4b3645ddb643adaa1439e32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:28.425188 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9de8d913-a503-4fb5-9ed1-f9c3081c4119 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 200 len: 1555 microversion: 2.1 time: 0.327352 Dec 15 14:22:28.425815 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 862/1812] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:28 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 1555 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:28.431456 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-fcee274d-38b2-4020-8149-d3d6fe4e01df req-fe474cee-4e74-448a-8478-a037fbdeaf5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30495aa3-75be-49a0-8151-5d522aca3b7e", "name": "network-vif-deleted", "tag": "9ef918c4-0e02-4d7a-813c-c4bb79ce69bf"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:22:28.433056 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:22:28.433056 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:22:28.440919 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-fcee274d-38b2-4020-8149-d3d6fe4e01df req-fe474cee-4e74-448a-8478-a037fbdeaf5c service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:28.441406 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-fcee274d-38b2-4020-8149-d3d6fe4e01df req-fe474cee-4e74-448a-8478-a037fbdeaf5c service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:28.455594 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-fcee274d-38b2-4020-8149-d3d6fe4e01df req-fe474cee-4e74-448a-8478-a037fbdeaf5c service nova] Creating event network-vif-deleted:9ef918c4-0e02-4d7a-813c-c4bb79ce69bf for instance 30495aa3-75be-49a0-8151-5d522aca3b7e on hv-cinder-82182 Dec 15 14:22:28.461192 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-fcee274d-38b2-4020-8149-d3d6fe4e01df req-fe474cee-4e74-448a-8478-a037fbdeaf5c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034051 Dec 15 14:22:28.461874 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 863/1813] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:22:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:22:28.496604 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-27e7dc9d-167f-4d35-b856-06daf6a3b965 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:28.505076 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-27e7dc9d-167f-4d35-b856-06daf6a3b965 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.229048 Dec 15 14:22:28.505656 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 951/1814] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:28 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:28.749334 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0191fea5-f222-4f89-b545-f5247ea9d8fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:28.750127 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0191fea5-f222-4f89-b545-f5247ea9d8fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:28.757191 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0191fea5-f222-4f89-b545-f5247ea9d8fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:28.757660 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0191fea5-f222-4f89-b545-f5247ea9d8fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:28.758521 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0191fea5-f222-4f89-b545-f5247ea9d8fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:28.759120 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0191fea5-f222-4f89-b545-f5247ea9d8fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:28.831335 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0191fea5-f222-4f89-b545-f5247ea9d8fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:28.839531 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0191fea5-f222-4f89-b545-f5247ea9d8fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.094207 Dec 15 14:22:28.840136 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 864/1815] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:28 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:29.444217 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-953ee216-71a6-4330-b3ed-d988a501b3be tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:29.445815 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-953ee216-71a6-4330-b3ed-d988a501b3be tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] [instance: 30495aa3-75be-49a0-8151-5d522aca3b7e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:29.453091 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-953ee216-71a6-4330-b3ed-d988a501b3be tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:29.453546 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-953ee216-71a6-4330-b3ed-d988a501b3be tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:29.454382 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-953ee216-71a6-4330-b3ed-d988a501b3be tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:29.454819 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-953ee216-71a6-4330-b3ed-d988a501b3be tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:29.469519 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-953ee216-71a6-4330-b3ed-d988a501b3be tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] HTTP exception thrown: Instance 30495aa3-75be-49a0-8151-5d522aca3b7e could not be found. Dec 15 14:22:29.470128 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-953ee216-71a6-4330-b3ed-d988a501b3be tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Returning 404 to user: Instance 30495aa3-75be-49a0-8151-5d522aca3b7e could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:22:29.470993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-953ee216-71a6-4330-b3ed-d988a501b3be tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e" status: 404 len: 111 microversion: 2.1 time: 0.030828 Dec 15 14:22:29.471518 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 952/1816] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:29 2021] GET /compute/v2.1/servers/30495aa3-75be-49a0-8151-5d522aca3b7e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:22:29.480236 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-359d5ff2-62b4-4d84-9374-c70ba6f99447 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] Calling method '.version_select at 0x7faa3c894dc0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:29.501821 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-359d5ff2-62b4-4d84-9374-c70ba6f99447 tempest-TestMinimumBasicScenario-1692329554 tempest-TestMinimumBasicScenario-1692329554-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1996515674" status: 202 len: 0 microversion: 2.1 time: 0.025148 Dec 15 14:22:29.502431 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 865/1817] 10.222.0.42 () {58 vars in 1271 bytes} [Wed Dec 15 14:22:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1996515674 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:22:29.522735 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b82977e5-167e-4886-a2fd-6c32cb0f226d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:29.523544 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b82977e5-167e-4886-a2fd-6c32cb0f226d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:29.530920 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b82977e5-167e-4886-a2fd-6c32cb0f226d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:29.531484 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b82977e5-167e-4886-a2fd-6c32cb0f226d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:29.532175 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b82977e5-167e-4886-a2fd-6c32cb0f226d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:29.532652 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b82977e5-167e-4886-a2fd-6c32cb0f226d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:29.687415 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b82977e5-167e-4886-a2fd-6c32cb0f226d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:29.696589 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b82977e5-167e-4886-a2fd-6c32cb0f226d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.177722 Dec 15 14:22:29.697121 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 953/1818] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:29 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:29.856619 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5fe0e747-9141-4333-aab5-526b6237745d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:29.857410 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5fe0e747-9141-4333-aab5-526b6237745d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:29.863992 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fe0e747-9141-4333-aab5-526b6237745d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:29.864438 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fe0e747-9141-4333-aab5-526b6237745d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:29.865265 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fe0e747-9141-4333-aab5-526b6237745d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:29.865763 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fe0e747-9141-4333-aab5-526b6237745d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:29.943907 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5fe0e747-9141-4333-aab5-526b6237745d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:29.952914 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5fe0e747-9141-4333-aab5-526b6237745d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.100164 Dec 15 14:22:29.953409 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 866/1819] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:29 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:30.715316 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-78637160-8f87-441e-94b6-90c52d22a3ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:30.716500 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-78637160-8f87-441e-94b6-90c52d22a3ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:30.724360 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-78637160-8f87-441e-94b6-90c52d22a3ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:30.724908 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-78637160-8f87-441e-94b6-90c52d22a3ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:30.725906 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-78637160-8f87-441e-94b6-90c52d22a3ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:30.726373 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-78637160-8f87-441e-94b6-90c52d22a3ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:30.971076 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-28a66aaf-4369-4920-a1c0-27064d50dd84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:30.971656 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-28a66aaf-4369-4920-a1c0-27064d50dd84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:30.979034 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28a66aaf-4369-4920-a1c0-27064d50dd84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:30.979486 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28a66aaf-4369-4920-a1c0-27064d50dd84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:30.980292 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28a66aaf-4369-4920-a1c0-27064d50dd84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:30.980723 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28a66aaf-4369-4920-a1c0-27064d50dd84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:31.087906 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-28a66aaf-4369-4920-a1c0-27064d50dd84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:31.096247 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-28a66aaf-4369-4920-a1c0-27064d50dd84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.128933 Dec 15 14:22:31.096829 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 867/1820] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:30 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:31.250676 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-78637160-8f87-441e-94b6-90c52d22a3ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:31.259680 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-78637160-8f87-441e-94b6-90c52d22a3ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.548317 Dec 15 14:22:31.260431 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 954/1821] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:30 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:32.117465 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-389df688-88b3-45e1-ad17-6564f9154eab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:32.118248 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-389df688-88b3-45e1-ad17-6564f9154eab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:32.125558 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-389df688-88b3-45e1-ad17-6564f9154eab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:32.126038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-389df688-88b3-45e1-ad17-6564f9154eab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:32.126842 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-389df688-88b3-45e1-ad17-6564f9154eab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:32.127292 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-389df688-88b3-45e1-ad17-6564f9154eab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:32.210257 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-389df688-88b3-45e1-ad17-6564f9154eab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:32.220842 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-389df688-88b3-45e1-ad17-6564f9154eab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.110032 Dec 15 14:22:32.221546 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 868/1822] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:32 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:32.278692 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d559ab56-bb93-4930-838f-f968f8b08c14 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:32.279419 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d559ab56-bb93-4930-838f-f968f8b08c14 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:32.286099 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d559ab56-bb93-4930-838f-f968f8b08c14 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:32.286887 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d559ab56-bb93-4930-838f-f968f8b08c14 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:32.287495 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d559ab56-bb93-4930-838f-f968f8b08c14 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:32.288189 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d559ab56-bb93-4930-838f-f968f8b08c14 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:32.462055 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d559ab56-bb93-4930-838f-f968f8b08c14 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:32.472542 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d559ab56-bb93-4930-838f-f968f8b08c14 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.198258 Dec 15 14:22:32.478879 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 955/1823] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:32 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:33.245057 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5578d5d7-2e19-4cf4-8405-6bd17772085f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:33.246180 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5578d5d7-2e19-4cf4-8405-6bd17772085f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:33.253110 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5578d5d7-2e19-4cf4-8405-6bd17772085f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:33.253558 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5578d5d7-2e19-4cf4-8405-6bd17772085f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:33.254430 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5578d5d7-2e19-4cf4-8405-6bd17772085f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:33.254888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5578d5d7-2e19-4cf4-8405-6bd17772085f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:33.323145 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5578d5d7-2e19-4cf4-8405-6bd17772085f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:33.331533 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5578d5d7-2e19-4cf4-8405-6bd17772085f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.091032 Dec 15 14:22:33.332142 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 869/1824] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:33 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:33.490750 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-213b5f6e-17d3-4b01-840a-8200cbb4730d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:33.491807 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-213b5f6e-17d3-4b01-840a-8200cbb4730d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:33.499215 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-213b5f6e-17d3-4b01-840a-8200cbb4730d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:33.499668 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-213b5f6e-17d3-4b01-840a-8200cbb4730d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:33.500481 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-213b5f6e-17d3-4b01-840a-8200cbb4730d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:33.500918 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-213b5f6e-17d3-4b01-840a-8200cbb4730d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:33.712795 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-213b5f6e-17d3-4b01-840a-8200cbb4730d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:33.722043 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-213b5f6e-17d3-4b01-840a-8200cbb4730d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.235073 Dec 15 14:22:33.723316 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 956/1825] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:33 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:34.349926 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4fae3b44-31b7-45ef-8e17-006fdce197b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:34.351634 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4fae3b44-31b7-45ef-8e17-006fdce197b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:34.363263 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4fae3b44-31b7-45ef-8e17-006fdce197b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:34.364954 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4fae3b44-31b7-45ef-8e17-006fdce197b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:34.367236 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4fae3b44-31b7-45ef-8e17-006fdce197b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:34.367970 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4fae3b44-31b7-45ef-8e17-006fdce197b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:34.484243 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4fae3b44-31b7-45ef-8e17-006fdce197b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:34.493884 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4fae3b44-31b7-45ef-8e17-006fdce197b9 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.148456 Dec 15 14:22:34.494491 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 870/1826] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:34 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:22:34.740426 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a6f90758-31b3-4442-9792-ad63f472f217 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:34.742072 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a6f90758-31b3-4442-9792-ad63f472f217 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:34.750811 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a6f90758-31b3-4442-9792-ad63f472f217 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:34.751296 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a6f90758-31b3-4442-9792-ad63f472f217 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:34.752192 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a6f90758-31b3-4442-9792-ad63f472f217 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:34.752644 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a6f90758-31b3-4442-9792-ad63f472f217 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:34.897033 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a6f90758-31b3-4442-9792-ad63f472f217 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:34.906608 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a6f90758-31b3-4442-9792-ad63f472f217 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.169735 Dec 15 14:22:34.907201 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 957/1827] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:34 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:35.516430 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-06fd4716-ba36-4b53-8321-52f783e0af82 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:35.518264 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-06fd4716-ba36-4b53-8321-52f783e0af82 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:35.527541 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06fd4716-ba36-4b53-8321-52f783e0af82 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:35.528394 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06fd4716-ba36-4b53-8321-52f783e0af82 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:35.529373 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06fd4716-ba36-4b53-8321-52f783e0af82 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:35.530074 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06fd4716-ba36-4b53-8321-52f783e0af82 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:35.618566 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-06fd4716-ba36-4b53-8321-52f783e0af82 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:35.627765 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-06fd4716-ba36-4b53-8321-52f783e0af82 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.115404 Dec 15 14:22:35.628360 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 871/1828] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:35 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:35.924850 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0fb9821f-45f4-4738-8374-3be9a3c61450 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:35.924850 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0fb9821f-45f4-4738-8374-3be9a3c61450 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:35.934326 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0fb9821f-45f4-4738-8374-3be9a3c61450 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:35.934752 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0fb9821f-45f4-4738-8374-3be9a3c61450 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:35.935596 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0fb9821f-45f4-4738-8374-3be9a3c61450 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:35.936035 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0fb9821f-45f4-4738-8374-3be9a3c61450 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:36.081399 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0fb9821f-45f4-4738-8374-3be9a3c61450 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:36.092127 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0fb9821f-45f4-4738-8374-3be9a3c61450 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.171477 Dec 15 14:22:36.092679 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 958/1829] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:35 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:36.647388 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e5d46ad7-43a4-4f28-b209-74c3d5c731d0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:36.648259 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e5d46ad7-43a4-4f28-b209-74c3d5c731d0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:36.655583 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5d46ad7-43a4-4f28-b209-74c3d5c731d0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:36.656489 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5d46ad7-43a4-4f28-b209-74c3d5c731d0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:36.657556 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5d46ad7-43a4-4f28-b209-74c3d5c731d0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:36.658325 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5d46ad7-43a4-4f28-b209-74c3d5c731d0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:36.732248 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e5d46ad7-43a4-4f28-b209-74c3d5c731d0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:36.740325 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e5d46ad7-43a4-4f28-b209-74c3d5c731d0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.097394 Dec 15 14:22:36.750108 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 872/1830] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:36 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:37.113085 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-47b5bfba-39c5-48e2-b7f4-41a648ce03b4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:37.114682 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-47b5bfba-39c5-48e2-b7f4-41a648ce03b4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:37.127478 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47b5bfba-39c5-48e2-b7f4-41a648ce03b4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:37.127478 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47b5bfba-39c5-48e2-b7f4-41a648ce03b4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:37.128145 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47b5bfba-39c5-48e2-b7f4-41a648ce03b4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:37.129173 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47b5bfba-39c5-48e2-b7f4-41a648ce03b4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:37.338302 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-47b5bfba-39c5-48e2-b7f4-41a648ce03b4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:37.351134 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-47b5bfba-39c5-48e2-b7f4-41a648ce03b4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.243865 Dec 15 14:22:37.352093 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 959/1831] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:37 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:37.766013 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2471309b-a25b-479e-9a55-2f718bc06158 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:37.767035 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2471309b-a25b-479e-9a55-2f718bc06158 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:37.785984 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2471309b-a25b-479e-9a55-2f718bc06158 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:37.786779 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2471309b-a25b-479e-9a55-2f718bc06158 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:37.788719 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2471309b-a25b-479e-9a55-2f718bc06158 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:37.789518 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2471309b-a25b-479e-9a55-2f718bc06158 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:37.893195 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2471309b-a25b-479e-9a55-2f718bc06158 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:37.906938 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2471309b-a25b-479e-9a55-2f718bc06158 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.151953 Dec 15 14:22:37.917220 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 873/1832] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:37 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:38.374696 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3e793a10-306a-4901-a3ee-2bc25c3883e6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:38.375385 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3e793a10-306a-4901-a3ee-2bc25c3883e6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:38.384834 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e793a10-306a-4901-a3ee-2bc25c3883e6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:38.385816 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e793a10-306a-4901-a3ee-2bc25c3883e6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:38.386981 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e793a10-306a-4901-a3ee-2bc25c3883e6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:38.387691 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e793a10-306a-4901-a3ee-2bc25c3883e6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:38.819518 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3e793a10-306a-4901-a3ee-2bc25c3883e6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:38.828845 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3e793a10-306a-4901-a3ee-2bc25c3883e6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.459267 Dec 15 14:22:38.829567 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 960/1833] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:38 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:38.925463 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-47f47e53-aceb-4120-80c1-035421fc1a1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:38.926182 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-47f47e53-aceb-4120-80c1-035421fc1a1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:38.932739 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47f47e53-aceb-4120-80c1-035421fc1a1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:38.933171 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47f47e53-aceb-4120-80c1-035421fc1a1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:38.933994 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47f47e53-aceb-4120-80c1-035421fc1a1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:38.934487 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47f47e53-aceb-4120-80c1-035421fc1a1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:39.001687 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-47f47e53-aceb-4120-80c1-035421fc1a1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:39.010036 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-47f47e53-aceb-4120-80c1-035421fc1a1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.088944 Dec 15 14:22:39.010981 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 874/1834] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:38 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:39.847746 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8254ab44-d04b-439d-9a66-4f78e5c9a6ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:39.848356 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8254ab44-d04b-439d-9a66-4f78e5c9a6ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:39.855386 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8254ab44-d04b-439d-9a66-4f78e5c9a6ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:39.855834 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8254ab44-d04b-439d-9a66-4f78e5c9a6ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:39.856626 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8254ab44-d04b-439d-9a66-4f78e5c9a6ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:39.857067 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8254ab44-d04b-439d-9a66-4f78e5c9a6ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:39.999781 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8254ab44-d04b-439d-9a66-4f78e5c9a6ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:40.008419 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8254ab44-d04b-439d-9a66-4f78e5c9a6ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.164387 Dec 15 14:22:40.009099 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 961/1835] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:39 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:40.028017 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6fb987ff-e037-4001-9d2a-14de02e8fc1c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:40.028645 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6fb987ff-e037-4001-9d2a-14de02e8fc1c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:40.035939 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fb987ff-e037-4001-9d2a-14de02e8fc1c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:40.036382 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fb987ff-e037-4001-9d2a-14de02e8fc1c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:40.037164 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fb987ff-e037-4001-9d2a-14de02e8fc1c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:40.037686 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fb987ff-e037-4001-9d2a-14de02e8fc1c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:40.107828 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6fb987ff-e037-4001-9d2a-14de02e8fc1c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:40.116072 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6fb987ff-e037-4001-9d2a-14de02e8fc1c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.091752 Dec 15 14:22:40.116668 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 875/1836] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:40 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:41.026286 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a692869a-f8c1-41f1-8f8e-69b7f939aaef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:41.026871 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a692869a-f8c1-41f1-8f8e-69b7f939aaef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:41.034093 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a692869a-f8c1-41f1-8f8e-69b7f939aaef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:41.034504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a692869a-f8c1-41f1-8f8e-69b7f939aaef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:41.035287 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a692869a-f8c1-41f1-8f8e-69b7f939aaef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:41.035728 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a692869a-f8c1-41f1-8f8e-69b7f939aaef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:41.134823 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ebc86afc-d748-4b04-9a0e-fece4f983821 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:41.135802 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ebc86afc-d748-4b04-9a0e-fece4f983821 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:41.146764 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebc86afc-d748-4b04-9a0e-fece4f983821 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:41.147551 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebc86afc-d748-4b04-9a0e-fece4f983821 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:41.149260 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebc86afc-d748-4b04-9a0e-fece4f983821 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:41.150129 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebc86afc-d748-4b04-9a0e-fece4f983821 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:41.206861 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a692869a-f8c1-41f1-8f8e-69b7f939aaef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:41.215408 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a692869a-f8c1-41f1-8f8e-69b7f939aaef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.193314 Dec 15 14:22:41.215967 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 962/1837] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:41 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:41.227570 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ebc86afc-d748-4b04-9a0e-fece4f983821 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:41.236285 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ebc86afc-d748-4b04-9a0e-fece4f983821 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.106149 Dec 15 14:22:41.236891 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 876/1838] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:41 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:42.235339 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ac0241c0-d2a5-4453-a35a-ac99fe3725ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:42.236247 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ac0241c0-d2a5-4453-a35a-ac99fe3725ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:42.243754 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac0241c0-d2a5-4453-a35a-ac99fe3725ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:42.244405 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac0241c0-d2a5-4453-a35a-ac99fe3725ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:42.245406 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac0241c0-d2a5-4453-a35a-ac99fe3725ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:42.245916 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac0241c0-d2a5-4453-a35a-ac99fe3725ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:42.254405 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e82d798c-dc65-41eb-8714-7e7ccd4d67ab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:42.255649 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e82d798c-dc65-41eb-8714-7e7ccd4d67ab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:42.262436 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e82d798c-dc65-41eb-8714-7e7ccd4d67ab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:42.262895 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e82d798c-dc65-41eb-8714-7e7ccd4d67ab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:42.263692 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e82d798c-dc65-41eb-8714-7e7ccd4d67ab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:42.264268 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e82d798c-dc65-41eb-8714-7e7ccd4d67ab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:42.346871 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e82d798c-dc65-41eb-8714-7e7ccd4d67ab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:42.354817 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e82d798c-dc65-41eb-8714-7e7ccd4d67ab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.104354 Dec 15 14:22:42.355405 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 877/1839] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:42 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:22:42.423844 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ac0241c0-d2a5-4453-a35a-ac99fe3725ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:42.432867 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ac0241c0-d2a5-4453-a35a-ac99fe3725ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.202684 Dec 15 14:22:42.433489 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 963/1840] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:42 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:43.372141 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9435a537-7839-491d-8e3f-b7771fdd2a70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:43.372887 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9435a537-7839-491d-8e3f-b7771fdd2a70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:43.379443 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9435a537-7839-491d-8e3f-b7771fdd2a70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:43.379885 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9435a537-7839-491d-8e3f-b7771fdd2a70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:43.380749 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9435a537-7839-491d-8e3f-b7771fdd2a70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:43.381342 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9435a537-7839-491d-8e3f-b7771fdd2a70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:43.452045 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4946e907-4f3d-41f2-be15-996d1bb792ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:43.452965 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9435a537-7839-491d-8e3f-b7771fdd2a70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:43.453154 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4946e907-4f3d-41f2-be15-996d1bb792ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:43.460580 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4946e907-4f3d-41f2-be15-996d1bb792ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:43.461113 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4946e907-4f3d-41f2-be15-996d1bb792ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:43.461387 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9435a537-7839-491d-8e3f-b7771fdd2a70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.093091 Dec 15 14:22:43.462255 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4946e907-4f3d-41f2-be15-996d1bb792ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:43.462563 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 878/1841] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:43 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:43.462764 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4946e907-4f3d-41f2-be15-996d1bb792ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:43.617990 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4946e907-4f3d-41f2-be15-996d1bb792ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:43.626234 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4946e907-4f3d-41f2-be15-996d1bb792ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.178360 Dec 15 14:22:43.626734 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 964/1842] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:43 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:22:44.480060 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9a4e17fb-2d0e-428f-bbd2-ca4271db40fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:44.480765 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9a4e17fb-2d0e-428f-bbd2-ca4271db40fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:44.491575 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a4e17fb-2d0e-428f-bbd2-ca4271db40fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:44.492025 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a4e17fb-2d0e-428f-bbd2-ca4271db40fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:44.492822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a4e17fb-2d0e-428f-bbd2-ca4271db40fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:44.493396 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a4e17fb-2d0e-428f-bbd2-ca4271db40fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:44.565228 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9a4e17fb-2d0e-428f-bbd2-ca4271db40fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:44.576447 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9a4e17fb-2d0e-428f-bbd2-ca4271db40fa tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.100071 Dec 15 14:22:44.577388 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 879/1843] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:44 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:44.649546 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-353cad58-8f6a-48df-a51b-127112eeed28 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:44.650335 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-353cad58-8f6a-48df-a51b-127112eeed28 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:44.660578 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-353cad58-8f6a-48df-a51b-127112eeed28 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:44.661220 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-353cad58-8f6a-48df-a51b-127112eeed28 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:44.662570 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-353cad58-8f6a-48df-a51b-127112eeed28 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:44.663171 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-353cad58-8f6a-48df-a51b-127112eeed28 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:44.814543 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-353cad58-8f6a-48df-a51b-127112eeed28 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:44.824887 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-353cad58-8f6a-48df-a51b-127112eeed28 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.181883 Dec 15 14:22:44.825450 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 965/1844] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:44 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:45.596693 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e5054893-02d0-4e9d-8a35-9cab69e3be08 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:45.597295 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e5054893-02d0-4e9d-8a35-9cab69e3be08 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:45.604276 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5054893-02d0-4e9d-8a35-9cab69e3be08 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:45.604722 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5054893-02d0-4e9d-8a35-9cab69e3be08 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:45.605505 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5054893-02d0-4e9d-8a35-9cab69e3be08 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:45.605982 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5054893-02d0-4e9d-8a35-9cab69e3be08 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:45.677277 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e5054893-02d0-4e9d-8a35-9cab69e3be08 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:45.685961 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e5054893-02d0-4e9d-8a35-9cab69e3be08 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.093035 Dec 15 14:22:45.686534 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 880/1845] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:45 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:45.842518 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8be4e8eb-3255-48b4-9d71-5b474ec19725 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:45.843167 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8be4e8eb-3255-48b4-9d71-5b474ec19725 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:45.850004 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8be4e8eb-3255-48b4-9d71-5b474ec19725 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:45.850450 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8be4e8eb-3255-48b4-9d71-5b474ec19725 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:45.851211 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8be4e8eb-3255-48b4-9d71-5b474ec19725 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:45.855459 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8be4e8eb-3255-48b4-9d71-5b474ec19725 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:46.029621 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8be4e8eb-3255-48b4-9d71-5b474ec19725 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:46.040920 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8be4e8eb-3255-48b4-9d71-5b474ec19725 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.201891 Dec 15 14:22:46.041600 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 966/1846] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:45 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:46.706896 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d36c15be-390d-432a-981a-7ca6dda4d9b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:46.708228 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d36c15be-390d-432a-981a-7ca6dda4d9b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:46.720670 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d36c15be-390d-432a-981a-7ca6dda4d9b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:46.721479 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d36c15be-390d-432a-981a-7ca6dda4d9b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:46.722968 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d36c15be-390d-432a-981a-7ca6dda4d9b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:46.723798 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d36c15be-390d-432a-981a-7ca6dda4d9b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:46.799670 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d36c15be-390d-432a-981a-7ca6dda4d9b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:46.811306 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d36c15be-390d-432a-981a-7ca6dda4d9b6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.110022 Dec 15 14:22:46.812182 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 881/1847] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:46 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:47.063015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bb25ab3b-afa1-4d0f-8bbe-f4ff0e622b25 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:47.063603 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bb25ab3b-afa1-4d0f-8bbe-f4ff0e622b25 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:47.074780 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb25ab3b-afa1-4d0f-8bbe-f4ff0e622b25 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:47.075476 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb25ab3b-afa1-4d0f-8bbe-f4ff0e622b25 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:47.076831 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb25ab3b-afa1-4d0f-8bbe-f4ff0e622b25 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:47.077521 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb25ab3b-afa1-4d0f-8bbe-f4ff0e622b25 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:47.227500 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bb25ab3b-afa1-4d0f-8bbe-f4ff0e622b25 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:47.236084 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bb25ab3b-afa1-4d0f-8bbe-f4ff0e622b25 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.179773 Dec 15 14:22:47.236658 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 967/1848] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:47 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:47.834758 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5148102c-c56c-4ce1-807a-5e7aa7b76b95 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:47.835394 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5148102c-c56c-4ce1-807a-5e7aa7b76b95 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:47.842590 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5148102c-c56c-4ce1-807a-5e7aa7b76b95 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:47.843037 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5148102c-c56c-4ce1-807a-5e7aa7b76b95 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:47.843841 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5148102c-c56c-4ce1-807a-5e7aa7b76b95 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:47.844277 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5148102c-c56c-4ce1-807a-5e7aa7b76b95 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:47.906176 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5148102c-c56c-4ce1-807a-5e7aa7b76b95 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:47.914026 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5148102c-c56c-4ce1-807a-5e7aa7b76b95 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.083457 Dec 15 14:22:47.914607 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 882/1849] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:47 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:48.254649 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-53b179f6-9091-453c-b471-3a2bdd701a3a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:48.255267 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-53b179f6-9091-453c-b471-3a2bdd701a3a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:48.262562 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53b179f6-9091-453c-b471-3a2bdd701a3a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:48.263009 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53b179f6-9091-453c-b471-3a2bdd701a3a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:48.263797 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53b179f6-9091-453c-b471-3a2bdd701a3a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:48.264229 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53b179f6-9091-453c-b471-3a2bdd701a3a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:48.436294 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-53b179f6-9091-453c-b471-3a2bdd701a3a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:48.448598 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-53b179f6-9091-453c-b471-3a2bdd701a3a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.197649 Dec 15 14:22:48.449737 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 968/1850] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:48 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:48.933389 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e30c1d7e-24b1-4578-8783-22e204119b58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:48.934417 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e30c1d7e-24b1-4578-8783-22e204119b58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:48.943336 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e30c1d7e-24b1-4578-8783-22e204119b58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:48.944089 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e30c1d7e-24b1-4578-8783-22e204119b58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:48.945482 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e30c1d7e-24b1-4578-8783-22e204119b58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:48.946288 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e30c1d7e-24b1-4578-8783-22e204119b58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:49.020156 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e30c1d7e-24b1-4578-8783-22e204119b58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:49.032797 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e30c1d7e-24b1-4578-8783-22e204119b58 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.103531 Dec 15 14:22:49.033278 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 883/1851] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:48 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:49.467283 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4e1a5c40-328e-4c00-a8f5-ee14260d6ede tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:49.467906 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4e1a5c40-328e-4c00-a8f5-ee14260d6ede tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:49.474798 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4e1a5c40-328e-4c00-a8f5-ee14260d6ede tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:49.475310 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4e1a5c40-328e-4c00-a8f5-ee14260d6ede tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:49.476275 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4e1a5c40-328e-4c00-a8f5-ee14260d6ede tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:49.476680 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4e1a5c40-328e-4c00-a8f5-ee14260d6ede tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:49.627366 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4e1a5c40-328e-4c00-a8f5-ee14260d6ede tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:49.638442 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4e1a5c40-328e-4c00-a8f5-ee14260d6ede tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.175540 Dec 15 14:22:49.639018 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 969/1852] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:49 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:50.053535 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-eed4327c-bcef-4c1d-871d-a70b7a3c0be1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:50.054114 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-eed4327c-bcef-4c1d-871d-a70b7a3c0be1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:50.061198 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eed4327c-bcef-4c1d-871d-a70b7a3c0be1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:50.061656 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eed4327c-bcef-4c1d-871d-a70b7a3c0be1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:50.062473 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eed4327c-bcef-4c1d-871d-a70b7a3c0be1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:50.062912 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eed4327c-bcef-4c1d-871d-a70b7a3c0be1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:50.128190 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-eed4327c-bcef-4c1d-871d-a70b7a3c0be1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:50.136146 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-eed4327c-bcef-4c1d-871d-a70b7a3c0be1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.086610 Dec 15 14:22:50.136722 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 884/1853] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:50 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:50.656515 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-238364b2-d392-4311-8254-95209c4dd0dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:50.657124 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-238364b2-d392-4311-8254-95209c4dd0dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:50.664126 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-238364b2-d392-4311-8254-95209c4dd0dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:50.664580 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-238364b2-d392-4311-8254-95209c4dd0dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:50.665354 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-238364b2-d392-4311-8254-95209c4dd0dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:50.665827 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-238364b2-d392-4311-8254-95209c4dd0dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:50.804941 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-238364b2-d392-4311-8254-95209c4dd0dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:50.814126 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-238364b2-d392-4311-8254-95209c4dd0dc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.161367 Dec 15 14:22:50.814688 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 970/1854] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:50 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:51.153622 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-42718d8c-1a91-4c14-8ff9-c36ca94d87e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:51.154241 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-42718d8c-1a91-4c14-8ff9-c36ca94d87e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:51.161093 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-42718d8c-1a91-4c14-8ff9-c36ca94d87e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:51.161544 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-42718d8c-1a91-4c14-8ff9-c36ca94d87e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:51.162358 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-42718d8c-1a91-4c14-8ff9-c36ca94d87e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:51.162796 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-42718d8c-1a91-4c14-8ff9-c36ca94d87e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:51.229583 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-42718d8c-1a91-4c14-8ff9-c36ca94d87e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:51.238278 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-42718d8c-1a91-4c14-8ff9-c36ca94d87e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.088474 Dec 15 14:22:51.238878 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 885/1855] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:51 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:51.833541 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3e5313e2-83f4-43c7-a214-23a4632d2753 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:51.834943 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3e5313e2-83f4-43c7-a214-23a4632d2753 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:51.843174 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e5313e2-83f4-43c7-a214-23a4632d2753 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:51.843695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e5313e2-83f4-43c7-a214-23a4632d2753 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:51.844538 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e5313e2-83f4-43c7-a214-23a4632d2753 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:51.845024 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e5313e2-83f4-43c7-a214-23a4632d2753 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:52.053651 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3e5313e2-83f4-43c7-a214-23a4632d2753 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:52.062636 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3e5313e2-83f4-43c7-a214-23a4632d2753 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.233071 Dec 15 14:22:52.063462 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 971/1856] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:51 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:52.260917 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-50678047-5f51-4463-846d-e5d484583cd2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:52.262088 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-50678047-5f51-4463-846d-e5d484583cd2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:52.273304 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50678047-5f51-4463-846d-e5d484583cd2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:52.274134 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50678047-5f51-4463-846d-e5d484583cd2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:52.275492 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50678047-5f51-4463-846d-e5d484583cd2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:52.277184 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50678047-5f51-4463-846d-e5d484583cd2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:52.389570 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-50678047-5f51-4463-846d-e5d484583cd2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:52.397542 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-50678047-5f51-4463-846d-e5d484583cd2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.144027 Dec 15 14:22:52.398175 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 886/1857] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:52 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:53.091130 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-62727e27-39a4-4390-8aa9-12db94649316 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:53.091713 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-62727e27-39a4-4390-8aa9-12db94649316 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:53.099219 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62727e27-39a4-4390-8aa9-12db94649316 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:53.099667 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62727e27-39a4-4390-8aa9-12db94649316 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:53.100446 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62727e27-39a4-4390-8aa9-12db94649316 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:53.100883 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62727e27-39a4-4390-8aa9-12db94649316 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:53.242782 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-62727e27-39a4-4390-8aa9-12db94649316 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:53.251811 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-62727e27-39a4-4390-8aa9-12db94649316 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.166474 Dec 15 14:22:53.262455 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 972/1858] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:53 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:53.414646 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f74dfc9e-4966-4ac4-9224-1d274536e725 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:53.415249 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f74dfc9e-4966-4ac4-9224-1d274536e725 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:53.422598 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f74dfc9e-4966-4ac4-9224-1d274536e725 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:53.423160 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f74dfc9e-4966-4ac4-9224-1d274536e725 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:53.423998 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f74dfc9e-4966-4ac4-9224-1d274536e725 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:53.424488 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f74dfc9e-4966-4ac4-9224-1d274536e725 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:53.489466 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f74dfc9e-4966-4ac4-9224-1d274536e725 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:53.497648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f74dfc9e-4966-4ac4-9224-1d274536e725 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.086891 Dec 15 14:22:53.498235 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 887/1859] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:53 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:54.271074 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-21038620-24d2-4264-920e-c956d1ede6e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:54.271677 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-21038620-24d2-4264-920e-c956d1ede6e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:54.278643 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21038620-24d2-4264-920e-c956d1ede6e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:54.279099 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21038620-24d2-4264-920e-c956d1ede6e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:54.279897 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21038620-24d2-4264-920e-c956d1ede6e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:54.280321 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21038620-24d2-4264-920e-c956d1ede6e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:54.427791 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-21038620-24d2-4264-920e-c956d1ede6e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:54.436768 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-21038620-24d2-4264-920e-c956d1ede6e2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.170070 Dec 15 14:22:54.437354 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 973/1860] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:54 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:54.515196 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-01ba8de5-90d2-46fa-98b7-85f2054ebf1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:54.515776 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-01ba8de5-90d2-46fa-98b7-85f2054ebf1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:54.522702 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01ba8de5-90d2-46fa-98b7-85f2054ebf1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:54.523079 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01ba8de5-90d2-46fa-98b7-85f2054ebf1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:54.523861 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01ba8de5-90d2-46fa-98b7-85f2054ebf1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:54.524291 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01ba8de5-90d2-46fa-98b7-85f2054ebf1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:54.597512 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-01ba8de5-90d2-46fa-98b7-85f2054ebf1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:54.608053 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-01ba8de5-90d2-46fa-98b7-85f2054ebf1d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.096774 Dec 15 14:22:54.608636 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 888/1861] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:54 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:55.454161 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0fc6207d-89de-49ed-85d6-d6f1ba5e733b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:55.454883 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0fc6207d-89de-49ed-85d6-d6f1ba5e733b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:55.462067 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0fc6207d-89de-49ed-85d6-d6f1ba5e733b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:55.462520 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0fc6207d-89de-49ed-85d6-d6f1ba5e733b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:55.463304 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0fc6207d-89de-49ed-85d6-d6f1ba5e733b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:55.463742 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0fc6207d-89de-49ed-85d6-d6f1ba5e733b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:55.619157 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0fc6207d-89de-49ed-85d6-d6f1ba5e733b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:55.624511 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-704ec977-b56b-4458-98e8-082e9d685a84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:55.625184 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-704ec977-b56b-4458-98e8-082e9d685a84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:55.628073 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0fc6207d-89de-49ed-85d6-d6f1ba5e733b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.177754 Dec 15 14:22:55.636972 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 974/1862] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:55 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:55.637174 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-704ec977-b56b-4458-98e8-082e9d685a84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:55.637174 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-704ec977-b56b-4458-98e8-082e9d685a84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:55.637174 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-704ec977-b56b-4458-98e8-082e9d685a84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:55.637174 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-704ec977-b56b-4458-98e8-082e9d685a84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:55.704080 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-704ec977-b56b-4458-98e8-082e9d685a84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:55.712389 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-704ec977-b56b-4458-98e8-082e9d685a84 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.091736 Dec 15 14:22:55.712974 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 889/1863] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:55 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:22:56.648533 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-15e63e27-474e-47dc-9fe0-48d929fe38e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:56.649179 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-15e63e27-474e-47dc-9fe0-48d929fe38e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:56.658871 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15e63e27-474e-47dc-9fe0-48d929fe38e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:56.659478 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15e63e27-474e-47dc-9fe0-48d929fe38e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:56.660675 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15e63e27-474e-47dc-9fe0-48d929fe38e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:56.661266 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15e63e27-474e-47dc-9fe0-48d929fe38e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:56.732896 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3ab1a32b-5151-415c-9842-33bb017c2991 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:56.733969 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3ab1a32b-5151-415c-9842-33bb017c2991 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:56.740994 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ab1a32b-5151-415c-9842-33bb017c2991 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:56.741481 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ab1a32b-5151-415c-9842-33bb017c2991 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:56.742348 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ab1a32b-5151-415c-9842-33bb017c2991 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:56.742789 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ab1a32b-5151-415c-9842-33bb017c2991 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:56.819969 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3ab1a32b-5151-415c-9842-33bb017c2991 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:56.829213 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3ab1a32b-5151-415c-9842-33bb017c2991 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.100382 Dec 15 14:22:56.829868 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 890/1864] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:56 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:22:56.833731 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-15e63e27-474e-47dc-9fe0-48d929fe38e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:56.842432 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-15e63e27-474e-47dc-9fe0-48d929fe38e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.199232 Dec 15 14:22:56.842432 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 975/1865] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:56 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:57.846777 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9e018be6-3075-42ad-b704-33a50f30c25a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:57.847400 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9e018be6-3075-42ad-b704-33a50f30c25a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:57.854456 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e018be6-3075-42ad-b704-33a50f30c25a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:57.854915 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e018be6-3075-42ad-b704-33a50f30c25a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:57.855741 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e018be6-3075-42ad-b704-33a50f30c25a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:57.856230 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e018be6-3075-42ad-b704-33a50f30c25a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:57.859274 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0e3950f3-6643-421e-96c1-afdab5453b44 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:57.860057 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0e3950f3-6643-421e-96c1-afdab5453b44 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:57.867062 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e3950f3-6643-421e-96c1-afdab5453b44 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:57.867683 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e3950f3-6643-421e-96c1-afdab5453b44 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:57.868511 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e3950f3-6643-421e-96c1-afdab5453b44 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:57.868949 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e3950f3-6643-421e-96c1-afdab5453b44 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:57.937829 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9e018be6-3075-42ad-b704-33a50f30c25a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:57.945363 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9e018be6-3075-42ad-b704-33a50f30c25a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.102270 Dec 15 14:22:57.946060 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 891/1866] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:57 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:22:58.031116 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0e3950f3-6643-421e-96c1-afdab5453b44 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:58.039996 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0e3950f3-6643-421e-96c1-afdab5453b44 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.184524 Dec 15 14:22:58.040585 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 976/1867] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:57 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:58.963314 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2932bf80-788b-4831-b0aa-a971081ec551 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:58.963940 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2932bf80-788b-4831-b0aa-a971081ec551 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:58.971013 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2932bf80-788b-4831-b0aa-a971081ec551 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:58.971456 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2932bf80-788b-4831-b0aa-a971081ec551 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:58.972236 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2932bf80-788b-4831-b0aa-a971081ec551 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:58.972668 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2932bf80-788b-4831-b0aa-a971081ec551 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:59.040502 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2932bf80-788b-4831-b0aa-a971081ec551 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:59.049344 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2932bf80-788b-4831-b0aa-a971081ec551 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.089857 Dec 15 14:22:59.049997 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 892/1868] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:58 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:59.057233 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-326be355-8884-4a6c-956d-e4d84f817f24 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:59.057939 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-326be355-8884-4a6c-956d-e4d84f817f24 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:59.065108 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-326be355-8884-4a6c-956d-e4d84f817f24 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:59.065566 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-326be355-8884-4a6c-956d-e4d84f817f24 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:59.066412 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-326be355-8884-4a6c-956d-e4d84f817f24 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:59.066850 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-326be355-8884-4a6c-956d-e4d84f817f24 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:59.217349 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-326be355-8884-4a6c-956d-e4d84f817f24 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:59.225740 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-326be355-8884-4a6c-956d-e4d84f817f24 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.172323 Dec 15 14:22:59.226442 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 977/1869] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:59 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:00.066505 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b1db3a66-6546-4b38-a36b-d0bb76784480 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:00.067087 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b1db3a66-6546-4b38-a36b-d0bb76784480 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:00.076932 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1db3a66-6546-4b38-a36b-d0bb76784480 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:00.077588 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1db3a66-6546-4b38-a36b-d0bb76784480 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:00.078439 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1db3a66-6546-4b38-a36b-d0bb76784480 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:00.078894 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1db3a66-6546-4b38-a36b-d0bb76784480 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:00.149438 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b1db3a66-6546-4b38-a36b-d0bb76784480 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:00.166878 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b1db3a66-6546-4b38-a36b-d0bb76784480 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.103566 Dec 15 14:23:00.167954 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 893/1870] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:00 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:00.244452 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-676ab674-4af0-4ec8-985d-af5fe3263b84 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:00.245088 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-676ab674-4af0-4ec8-985d-af5fe3263b84 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:00.251844 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-676ab674-4af0-4ec8-985d-af5fe3263b84 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:00.252322 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-676ab674-4af0-4ec8-985d-af5fe3263b84 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:00.253099 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-676ab674-4af0-4ec8-985d-af5fe3263b84 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:00.253522 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-676ab674-4af0-4ec8-985d-af5fe3263b84 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:00.413984 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-676ab674-4af0-4ec8-985d-af5fe3263b84 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:00.424505 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-676ab674-4af0-4ec8-985d-af5fe3263b84 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.183930 Dec 15 14:23:00.425096 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 978/1871] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:00 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:01.188271 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7a6a1254-5a92-4170-9987-8405958a139a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:01.189278 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7a6a1254-5a92-4170-9987-8405958a139a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:01.197254 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a6a1254-5a92-4170-9987-8405958a139a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:01.197729 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a6a1254-5a92-4170-9987-8405958a139a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:01.198622 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a6a1254-5a92-4170-9987-8405958a139a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:01.199625 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a6a1254-5a92-4170-9987-8405958a139a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:01.268646 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7a6a1254-5a92-4170-9987-8405958a139a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:01.277388 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7a6a1254-5a92-4170-9987-8405958a139a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.094676 Dec 15 14:23:01.278057 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 894/1872] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:01 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:01.442835 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-48ffc819-3833-46bb-9462-df00fe6558b8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:01.443423 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-48ffc819-3833-46bb-9462-df00fe6558b8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:01.450767 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48ffc819-3833-46bb-9462-df00fe6558b8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:01.451223 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48ffc819-3833-46bb-9462-df00fe6558b8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:01.452018 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48ffc819-3833-46bb-9462-df00fe6558b8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:01.452455 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48ffc819-3833-46bb-9462-df00fe6558b8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:01.600709 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-48ffc819-3833-46bb-9462-df00fe6558b8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:01.612867 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-48ffc819-3833-46bb-9462-df00fe6558b8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.173838 Dec 15 14:23:01.613629 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 979/1873] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:01 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:02.294603 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-90df6557-b535-453d-bd3b-0332374ec250 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:02.295240 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-90df6557-b535-453d-bd3b-0332374ec250 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:02.302485 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90df6557-b535-453d-bd3b-0332374ec250 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:02.302903 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90df6557-b535-453d-bd3b-0332374ec250 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:02.303687 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90df6557-b535-453d-bd3b-0332374ec250 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:02.304760 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90df6557-b535-453d-bd3b-0332374ec250 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:02.374599 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90df6557-b535-453d-bd3b-0332374ec250 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:02.384947 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-90df6557-b535-453d-bd3b-0332374ec250 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.094525 Dec 15 14:23:02.385528 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 895/1874] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:02 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:02.635034 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-39f0a405-60d5-4fc8-8566-aa4976179ac7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:02.635704 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-39f0a405-60d5-4fc8-8566-aa4976179ac7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:02.642526 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39f0a405-60d5-4fc8-8566-aa4976179ac7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:02.642980 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39f0a405-60d5-4fc8-8566-aa4976179ac7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:02.643781 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39f0a405-60d5-4fc8-8566-aa4976179ac7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:02.644219 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39f0a405-60d5-4fc8-8566-aa4976179ac7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:02.789600 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-39f0a405-60d5-4fc8-8566-aa4976179ac7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:02.800873 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-39f0a405-60d5-4fc8-8566-aa4976179ac7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.169795 Dec 15 14:23:02.801944 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 980/1875] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:02 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:03.405733 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8c0fd77f-1ac0-4907-ba47-9dea84753034 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:03.406458 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8c0fd77f-1ac0-4907-ba47-9dea84753034 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:03.415356 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c0fd77f-1ac0-4907-ba47-9dea84753034 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:03.415805 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c0fd77f-1ac0-4907-ba47-9dea84753034 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:03.416592 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c0fd77f-1ac0-4907-ba47-9dea84753034 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:03.417022 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c0fd77f-1ac0-4907-ba47-9dea84753034 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:03.483391 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8c0fd77f-1ac0-4907-ba47-9dea84753034 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:03.492783 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8c0fd77f-1ac0-4907-ba47-9dea84753034 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.090717 Dec 15 14:23:03.493423 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 896/1876] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:03 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:03.819480 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6faa1535-a229-466e-acc5-a9c0261b44de tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:03.820184 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6faa1535-a229-466e-acc5-a9c0261b44de tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:03.828128 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6faa1535-a229-466e-acc5-a9c0261b44de tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:03.828575 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6faa1535-a229-466e-acc5-a9c0261b44de tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:03.829379 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6faa1535-a229-466e-acc5-a9c0261b44de tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:03.829929 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6faa1535-a229-466e-acc5-a9c0261b44de tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:03.985045 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6faa1535-a229-466e-acc5-a9c0261b44de tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:03.996800 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6faa1535-a229-466e-acc5-a9c0261b44de tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.181044 Dec 15 14:23:03.997488 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 981/1877] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:03 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:04.511223 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-efa6b1d4-76aa-44f9-9715-acb9e24fed4f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:04.511855 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-efa6b1d4-76aa-44f9-9715-acb9e24fed4f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:04.518887 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-efa6b1d4-76aa-44f9-9715-acb9e24fed4f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:04.519346 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-efa6b1d4-76aa-44f9-9715-acb9e24fed4f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:04.520168 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-efa6b1d4-76aa-44f9-9715-acb9e24fed4f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:04.520631 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-efa6b1d4-76aa-44f9-9715-acb9e24fed4f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:04.582454 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-efa6b1d4-76aa-44f9-9715-acb9e24fed4f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:04.591219 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-efa6b1d4-76aa-44f9-9715-acb9e24fed4f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.084073 Dec 15 14:23:04.591797 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 897/1878] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:04 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:05.020397 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9cf6566e-704d-46fc-b786-5b583188a331 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:05.021143 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9cf6566e-704d-46fc-b786-5b583188a331 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:05.028391 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9cf6566e-704d-46fc-b786-5b583188a331 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:05.028834 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9cf6566e-704d-46fc-b786-5b583188a331 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:05.029691 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9cf6566e-704d-46fc-b786-5b583188a331 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:05.030131 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9cf6566e-704d-46fc-b786-5b583188a331 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:05.173402 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9cf6566e-704d-46fc-b786-5b583188a331 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:05.183420 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9cf6566e-704d-46fc-b786-5b583188a331 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.168062 Dec 15 14:23:05.184065 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 982/1879] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:05 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:05.608848 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-17c35f13-cd0c-4ddc-8e20-7debbf5c0bb0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:05.609469 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-17c35f13-cd0c-4ddc-8e20-7debbf5c0bb0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:05.616049 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17c35f13-cd0c-4ddc-8e20-7debbf5c0bb0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:05.616498 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17c35f13-cd0c-4ddc-8e20-7debbf5c0bb0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:05.617271 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17c35f13-cd0c-4ddc-8e20-7debbf5c0bb0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:05.617875 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17c35f13-cd0c-4ddc-8e20-7debbf5c0bb0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:05.684832 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-17c35f13-cd0c-4ddc-8e20-7debbf5c0bb0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:05.692676 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-17c35f13-cd0c-4ddc-8e20-7debbf5c0bb0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.087909 Dec 15 14:23:05.693258 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 898/1880] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:05 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:06.202438 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cd519e9d-dd28-4883-85d5-b59c6f98ed94 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:06.203116 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cd519e9d-dd28-4883-85d5-b59c6f98ed94 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:06.210803 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd519e9d-dd28-4883-85d5-b59c6f98ed94 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:06.211247 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd519e9d-dd28-4883-85d5-b59c6f98ed94 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:06.212101 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd519e9d-dd28-4883-85d5-b59c6f98ed94 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:06.212587 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd519e9d-dd28-4883-85d5-b59c6f98ed94 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:06.357492 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cd519e9d-dd28-4883-85d5-b59c6f98ed94 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:06.373526 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cd519e9d-dd28-4883-85d5-b59c6f98ed94 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.175457 Dec 15 14:23:06.374563 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 983/1881] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:06 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:06.710181 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fde9db94-fb41-43f6-9029-85290f217eaf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:06.710803 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fde9db94-fb41-43f6-9029-85290f217eaf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:06.717899 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fde9db94-fb41-43f6-9029-85290f217eaf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:06.718327 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fde9db94-fb41-43f6-9029-85290f217eaf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:06.719139 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fde9db94-fb41-43f6-9029-85290f217eaf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:06.719578 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fde9db94-fb41-43f6-9029-85290f217eaf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:06.787843 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fde9db94-fb41-43f6-9029-85290f217eaf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:06.795691 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fde9db94-fb41-43f6-9029-85290f217eaf tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.089290 Dec 15 14:23:06.796274 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 899/1882] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:06 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:07.394405 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c4e4c4c1-c05b-4ce5-9006-4e37b0462c61 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:07.395008 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c4e4c4c1-c05b-4ce5-9006-4e37b0462c61 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:07.401522 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4e4c4c1-c05b-4ce5-9006-4e37b0462c61 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:07.402003 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4e4c4c1-c05b-4ce5-9006-4e37b0462c61 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:07.402789 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4e4c4c1-c05b-4ce5-9006-4e37b0462c61 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:07.403226 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4e4c4c1-c05b-4ce5-9006-4e37b0462c61 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:07.553967 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c4e4c4c1-c05b-4ce5-9006-4e37b0462c61 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:07.562497 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c4e4c4c1-c05b-4ce5-9006-4e37b0462c61 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.171806 Dec 15 14:23:07.563075 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 984/1883] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:07 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:07.813523 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-40679fa1-6fe3-450c-b9e5-2ce16f49f411 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:07.814169 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-40679fa1-6fe3-450c-b9e5-2ce16f49f411 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:07.821365 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40679fa1-6fe3-450c-b9e5-2ce16f49f411 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:07.821854 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40679fa1-6fe3-450c-b9e5-2ce16f49f411 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:07.822659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40679fa1-6fe3-450c-b9e5-2ce16f49f411 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:07.823106 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40679fa1-6fe3-450c-b9e5-2ce16f49f411 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:07.895252 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-40679fa1-6fe3-450c-b9e5-2ce16f49f411 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:07.906655 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-40679fa1-6fe3-450c-b9e5-2ce16f49f411 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.096691 Dec 15 14:23:07.907548 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 900/1884] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:07 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:08.580627 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a841ec04-d814-44ff-8c80-b9d56efba785 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:08.581273 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a841ec04-d814-44ff-8c80-b9d56efba785 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:08.588808 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a841ec04-d814-44ff-8c80-b9d56efba785 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:08.589282 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a841ec04-d814-44ff-8c80-b9d56efba785 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:08.590077 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a841ec04-d814-44ff-8c80-b9d56efba785 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:08.590504 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a841ec04-d814-44ff-8c80-b9d56efba785 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:08.751368 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a841ec04-d814-44ff-8c80-b9d56efba785 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:08.759885 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a841ec04-d814-44ff-8c80-b9d56efba785 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.183045 Dec 15 14:23:08.760457 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 985/1885] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:08 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:08.928209 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4cccc3eb-a327-43b4-8698-6427ecfb283c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:08.928788 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4cccc3eb-a327-43b4-8698-6427ecfb283c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:08.936648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4cccc3eb-a327-43b4-8698-6427ecfb283c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:08.937069 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4cccc3eb-a327-43b4-8698-6427ecfb283c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:08.937940 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4cccc3eb-a327-43b4-8698-6427ecfb283c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:08.938376 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4cccc3eb-a327-43b4-8698-6427ecfb283c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:09.010082 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4cccc3eb-a327-43b4-8698-6427ecfb283c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:09.021815 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4cccc3eb-a327-43b4-8698-6427ecfb283c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.099505 Dec 15 14:23:09.022755 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 901/1886] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:08 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:09.778120 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c3237ce5-8d14-432d-bd41-80d44d58db99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:09.778786 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c3237ce5-8d14-432d-bd41-80d44d58db99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:09.785873 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3237ce5-8d14-432d-bd41-80d44d58db99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:09.786317 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3237ce5-8d14-432d-bd41-80d44d58db99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:09.787121 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3237ce5-8d14-432d-bd41-80d44d58db99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:09.787568 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3237ce5-8d14-432d-bd41-80d44d58db99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:09.939048 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c3237ce5-8d14-432d-bd41-80d44d58db99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:09.947678 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c3237ce5-8d14-432d-bd41-80d44d58db99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.173809 Dec 15 14:23:09.948297 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 986/1887] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:09 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:10.042980 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-54da2a77-62e4-4fe7-a975-4211ca82d6e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:10.043833 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-54da2a77-62e4-4fe7-a975-4211ca82d6e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:10.050584 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54da2a77-62e4-4fe7-a975-4211ca82d6e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:10.051022 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54da2a77-62e4-4fe7-a975-4211ca82d6e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:10.051870 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54da2a77-62e4-4fe7-a975-4211ca82d6e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:10.052307 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54da2a77-62e4-4fe7-a975-4211ca82d6e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:10.124518 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-54da2a77-62e4-4fe7-a975-4211ca82d6e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:10.133061 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-54da2a77-62e4-4fe7-a975-4211ca82d6e5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.096052 Dec 15 14:23:10.133604 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 902/1888] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:10 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:10.970775 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b16763bd-314d-4c08-abd8-36e69de9c7d4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:10.971392 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b16763bd-314d-4c08-abd8-36e69de9c7d4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:10.980929 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b16763bd-314d-4c08-abd8-36e69de9c7d4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:10.981916 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b16763bd-314d-4c08-abd8-36e69de9c7d4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:10.982734 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b16763bd-314d-4c08-abd8-36e69de9c7d4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:10.983194 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b16763bd-314d-4c08-abd8-36e69de9c7d4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:11.131527 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b16763bd-314d-4c08-abd8-36e69de9c7d4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:11.141639 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b16763bd-314d-4c08-abd8-36e69de9c7d4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.176086 Dec 15 14:23:11.142258 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 987/1889] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:10 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:11.151104 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d72dbaf3-ff60-4897-81a8-8dcd56131158 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:11.151713 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d72dbaf3-ff60-4897-81a8-8dcd56131158 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:11.158923 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d72dbaf3-ff60-4897-81a8-8dcd56131158 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:11.159374 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d72dbaf3-ff60-4897-81a8-8dcd56131158 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:11.160153 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d72dbaf3-ff60-4897-81a8-8dcd56131158 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:11.160593 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d72dbaf3-ff60-4897-81a8-8dcd56131158 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:11.230336 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d72dbaf3-ff60-4897-81a8-8dcd56131158 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:11.238829 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d72dbaf3-ff60-4897-81a8-8dcd56131158 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.091503 Dec 15 14:23:11.239419 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 903/1890] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:11 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:12.160142 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fb69552a-1cd9-4718-a1e1-5c77e563e5a0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:12.160777 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fb69552a-1cd9-4718-a1e1-5c77e563e5a0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:12.167602 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb69552a-1cd9-4718-a1e1-5c77e563e5a0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:12.168053 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb69552a-1cd9-4718-a1e1-5c77e563e5a0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:12.168818 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb69552a-1cd9-4718-a1e1-5c77e563e5a0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:12.169277 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb69552a-1cd9-4718-a1e1-5c77e563e5a0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:12.256799 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4c7989a7-84f5-4d7b-b385-55e60d3314b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:12.257410 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4c7989a7-84f5-4d7b-b385-55e60d3314b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:12.264179 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4c7989a7-84f5-4d7b-b385-55e60d3314b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:12.264749 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4c7989a7-84f5-4d7b-b385-55e60d3314b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:12.265700 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4c7989a7-84f5-4d7b-b385-55e60d3314b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:12.266133 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4c7989a7-84f5-4d7b-b385-55e60d3314b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:12.318235 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fb69552a-1cd9-4718-a1e1-5c77e563e5a0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:12.327017 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fb69552a-1cd9-4718-a1e1-5c77e563e5a0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.170654 Dec 15 14:23:12.327633 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 988/1891] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:12 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:12.334219 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4c7989a7-84f5-4d7b-b385-55e60d3314b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:12.342657 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4c7989a7-84f5-4d7b-b385-55e60d3314b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.089820 Dec 15 14:23:12.343297 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 904/1892] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:12 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:13.344917 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5bf8c424-8c9f-441e-aa60-91e4b1f5ea19 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:13.346020 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5bf8c424-8c9f-441e-aa60-91e4b1f5ea19 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:13.352936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5bf8c424-8c9f-441e-aa60-91e4b1f5ea19 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:13.353411 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5bf8c424-8c9f-441e-aa60-91e4b1f5ea19 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:13.354315 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5bf8c424-8c9f-441e-aa60-91e4b1f5ea19 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:13.354744 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5bf8c424-8c9f-441e-aa60-91e4b1f5ea19 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:13.360426 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-816eea49-a459-4b54-85ae-aec712b0ccf2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:13.360975 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-816eea49-a459-4b54-85ae-aec712b0ccf2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:13.370277 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-816eea49-a459-4b54-85ae-aec712b0ccf2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:13.371017 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-816eea49-a459-4b54-85ae-aec712b0ccf2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:13.372134 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-816eea49-a459-4b54-85ae-aec712b0ccf2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:13.372564 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-816eea49-a459-4b54-85ae-aec712b0ccf2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:13.463911 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-816eea49-a459-4b54-85ae-aec712b0ccf2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:13.479670 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-816eea49-a459-4b54-85ae-aec712b0ccf2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.122548 Dec 15 14:23:13.487533 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 905/1893] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:13 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:23:13.556289 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5bf8c424-8c9f-441e-aa60-91e4b1f5ea19 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:13.565450 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5bf8c424-8c9f-441e-aa60-91e4b1f5ea19 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.224721 Dec 15 14:23:13.566074 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 989/1894] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:13 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:14.518357 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a3da050e-56a1-49bf-bce8-a7f9cbe14c10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:14.518985 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a3da050e-56a1-49bf-bce8-a7f9cbe14c10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:14.526722 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3da050e-56a1-49bf-bce8-a7f9cbe14c10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:14.527221 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3da050e-56a1-49bf-bce8-a7f9cbe14c10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:14.528174 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3da050e-56a1-49bf-bce8-a7f9cbe14c10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:14.528768 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3da050e-56a1-49bf-bce8-a7f9cbe14c10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:14.586674 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c9a0a10a-5f68-4796-ae7c-e7a632a0cf27 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:14.587567 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c9a0a10a-5f68-4796-ae7c-e7a632a0cf27 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:14.594672 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c9a0a10a-5f68-4796-ae7c-e7a632a0cf27 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:14.595765 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c9a0a10a-5f68-4796-ae7c-e7a632a0cf27 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:14.596677 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c9a0a10a-5f68-4796-ae7c-e7a632a0cf27 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:14.596929 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c9a0a10a-5f68-4796-ae7c-e7a632a0cf27 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:14.598542 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a3da050e-56a1-49bf-bce8-a7f9cbe14c10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:14.607309 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a3da050e-56a1-49bf-bce8-a7f9cbe14c10 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.098950 Dec 15 14:23:14.609035 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 906/1895] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:14 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:14.794340 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c9a0a10a-5f68-4796-ae7c-e7a632a0cf27 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:14.805014 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c9a0a10a-5f68-4796-ae7c-e7a632a0cf27 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.222551 Dec 15 14:23:14.805862 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 990/1896] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:14 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:15.624659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4de2f8d1-ffc0-4eb2-b2e5-50501ac712b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:15.625449 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4de2f8d1-ffc0-4eb2-b2e5-50501ac712b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:15.632157 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4de2f8d1-ffc0-4eb2-b2e5-50501ac712b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:15.632584 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4de2f8d1-ffc0-4eb2-b2e5-50501ac712b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:15.633405 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4de2f8d1-ffc0-4eb2-b2e5-50501ac712b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:15.633896 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4de2f8d1-ffc0-4eb2-b2e5-50501ac712b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:15.703094 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4de2f8d1-ffc0-4eb2-b2e5-50501ac712b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:15.713283 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4de2f8d1-ffc0-4eb2-b2e5-50501ac712b4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.092282 Dec 15 14:23:15.714648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 907/1897] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:15 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:15.829845 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-25f9f32f-0fac-4c0c-8758-83c47585937f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:15.830725 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-25f9f32f-0fac-4c0c-8758-83c47585937f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:15.837754 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-25f9f32f-0fac-4c0c-8758-83c47585937f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:15.838240 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-25f9f32f-0fac-4c0c-8758-83c47585937f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:15.839051 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-25f9f32f-0fac-4c0c-8758-83c47585937f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:15.839480 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-25f9f32f-0fac-4c0c-8758-83c47585937f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:16.017355 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-25f9f32f-0fac-4c0c-8758-83c47585937f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:16.025993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-25f9f32f-0fac-4c0c-8758-83c47585937f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.203102 Dec 15 14:23:16.026600 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 991/1898] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:15 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:16.993139 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c632af6a-9fbf-4642-9ed6-bfc1b6f30796 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:16.993770 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c632af6a-9fbf-4642-9ed6-bfc1b6f30796 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:17.002459 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c632af6a-9fbf-4642-9ed6-bfc1b6f30796 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:17.002909 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c632af6a-9fbf-4642-9ed6-bfc1b6f30796 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:17.003713 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c632af6a-9fbf-4642-9ed6-bfc1b6f30796 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:17.004159 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c632af6a-9fbf-4642-9ed6-bfc1b6f30796 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:17.051612 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a2396ed4-110b-4514-bdad-759d2fc00ca3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:17.052308 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a2396ed4-110b-4514-bdad-759d2fc00ca3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:17.061097 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2396ed4-110b-4514-bdad-759d2fc00ca3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:17.061826 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2396ed4-110b-4514-bdad-759d2fc00ca3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:17.063281 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2396ed4-110b-4514-bdad-759d2fc00ca3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:17.063936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2396ed4-110b-4514-bdad-759d2fc00ca3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:17.073229 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c632af6a-9fbf-4642-9ed6-bfc1b6f30796 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:17.082450 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c632af6a-9fbf-4642-9ed6-bfc1b6f30796 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.353446 Dec 15 14:23:17.083057 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 908/1899] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:16 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:17.228207 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a2396ed4-110b-4514-bdad-759d2fc00ca3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:17.237154 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a2396ed4-110b-4514-bdad-759d2fc00ca3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.193501 Dec 15 14:23:17.237931 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 992/1900] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:17 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:23:18.100136 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9a1c0e51-b355-45b7-90fd-ff8ce9cbcf86 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:18.100782 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9a1c0e51-b355-45b7-90fd-ff8ce9cbcf86 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:18.107655 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a1c0e51-b355-45b7-90fd-ff8ce9cbcf86 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:18.108096 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a1c0e51-b355-45b7-90fd-ff8ce9cbcf86 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:18.108906 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a1c0e51-b355-45b7-90fd-ff8ce9cbcf86 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:18.109356 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a1c0e51-b355-45b7-90fd-ff8ce9cbcf86 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:18.177167 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9a1c0e51-b355-45b7-90fd-ff8ce9cbcf86 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:18.185765 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9a1c0e51-b355-45b7-90fd-ff8ce9cbcf86 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.089452 Dec 15 14:23:18.186391 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 909/1901] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:18 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:18.256329 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-427c5b25-6131-42da-a30d-ab6da09b9969 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:18.256956 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-427c5b25-6131-42da-a30d-ab6da09b9969 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:18.263719 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-427c5b25-6131-42da-a30d-ab6da09b9969 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:18.264162 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-427c5b25-6131-42da-a30d-ab6da09b9969 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:18.264963 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-427c5b25-6131-42da-a30d-ab6da09b9969 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:18.265396 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-427c5b25-6131-42da-a30d-ab6da09b9969 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:18.440664 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-427c5b25-6131-42da-a30d-ab6da09b9969 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:18.453778 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-427c5b25-6131-42da-a30d-ab6da09b9969 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.201046 Dec 15 14:23:18.454802 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 993/1902] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:18 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:19.206709 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b7aefb6f-0d3b-4e90-9841-d49e4f4d8e71 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:19.207665 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b7aefb6f-0d3b-4e90-9841-d49e4f4d8e71 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:19.215046 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7aefb6f-0d3b-4e90-9841-d49e4f4d8e71 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:19.215518 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7aefb6f-0d3b-4e90-9841-d49e4f4d8e71 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:19.216325 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7aefb6f-0d3b-4e90-9841-d49e4f4d8e71 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:19.216772 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7aefb6f-0d3b-4e90-9841-d49e4f4d8e71 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:19.393553 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b7aefb6f-0d3b-4e90-9841-d49e4f4d8e71 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:19.402018 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b7aefb6f-0d3b-4e90-9841-d49e4f4d8e71 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.200682 Dec 15 14:23:19.402769 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 910/1903] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:19 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:19.481531 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a2c0f22e-999a-4bf1-ba9c-884fcba2e90f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:19.482745 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a2c0f22e-999a-4bf1-ba9c-884fcba2e90f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:19.490166 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2c0f22e-999a-4bf1-ba9c-884fcba2e90f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:19.490611 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2c0f22e-999a-4bf1-ba9c-884fcba2e90f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:19.491412 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2c0f22e-999a-4bf1-ba9c-884fcba2e90f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:19.491845 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2c0f22e-999a-4bf1-ba9c-884fcba2e90f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:19.652290 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a2c0f22e-999a-4bf1-ba9c-884fcba2e90f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:19.661384 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a2c0f22e-999a-4bf1-ba9c-884fcba2e90f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.187157 Dec 15 14:23:19.662094 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 994/1904] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:19 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:20.419899 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-90608677-f458-4c09-b0b8-68151945b464 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:20.420548 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-90608677-f458-4c09-b0b8-68151945b464 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:20.428518 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90608677-f458-4c09-b0b8-68151945b464 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:20.429183 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90608677-f458-4c09-b0b8-68151945b464 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:20.430014 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90608677-f458-4c09-b0b8-68151945b464 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:20.430457 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90608677-f458-4c09-b0b8-68151945b464 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:20.497524 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90608677-f458-4c09-b0b8-68151945b464 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:20.505697 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-90608677-f458-4c09-b0b8-68151945b464 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.090366 Dec 15 14:23:20.506300 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 911/1905] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:20 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:20.685676 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d866e31e-268d-4c7c-a971-373a57b25735 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:20.686305 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d866e31e-268d-4c7c-a971-373a57b25735 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:20.693702 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d866e31e-268d-4c7c-a971-373a57b25735 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:20.694165 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d866e31e-268d-4c7c-a971-373a57b25735 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:20.694980 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d866e31e-268d-4c7c-a971-373a57b25735 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:20.695421 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d866e31e-268d-4c7c-a971-373a57b25735 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:20.838155 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d866e31e-268d-4c7c-a971-373a57b25735 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:20.846698 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d866e31e-268d-4c7c-a971-373a57b25735 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.166102 Dec 15 14:23:20.847277 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 995/1906] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:20 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:21.523879 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8f21aeea-b1ca-444b-b3b0-4e40f210423c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:21.524478 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8f21aeea-b1ca-444b-b3b0-4e40f210423c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:21.532414 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f21aeea-b1ca-444b-b3b0-4e40f210423c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:21.532947 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f21aeea-b1ca-444b-b3b0-4e40f210423c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:21.535338 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f21aeea-b1ca-444b-b3b0-4e40f210423c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:21.535338 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f21aeea-b1ca-444b-b3b0-4e40f210423c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:21.609350 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8f21aeea-b1ca-444b-b3b0-4e40f210423c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:21.618435 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8f21aeea-b1ca-444b-b3b0-4e40f210423c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.098600 Dec 15 14:23:21.619515 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 912/1907] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:21 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:21.866952 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0e8a5feb-13c4-4d58-bfdf-cc5f339ca741 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:21.867586 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0e8a5feb-13c4-4d58-bfdf-cc5f339ca741 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:21.874134 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e8a5feb-13c4-4d58-bfdf-cc5f339ca741 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:21.874577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e8a5feb-13c4-4d58-bfdf-cc5f339ca741 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:21.875363 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e8a5feb-13c4-4d58-bfdf-cc5f339ca741 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:21.875791 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e8a5feb-13c4-4d58-bfdf-cc5f339ca741 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:22.042846 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0e8a5feb-13c4-4d58-bfdf-cc5f339ca741 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:22.053514 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0e8a5feb-13c4-4d58-bfdf-cc5f339ca741 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.190418 Dec 15 14:23:22.054409 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 996/1908] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:21 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:22.639911 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-267ce997-2bda-4c8d-8e58-a6531d6dd6fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:22.640584 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-267ce997-2bda-4c8d-8e58-a6531d6dd6fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:22.648873 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-267ce997-2bda-4c8d-8e58-a6531d6dd6fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:22.649602 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-267ce997-2bda-4c8d-8e58-a6531d6dd6fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:22.650901 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-267ce997-2bda-4c8d-8e58-a6531d6dd6fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:22.651339 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-267ce997-2bda-4c8d-8e58-a6531d6dd6fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:22.722217 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-267ce997-2bda-4c8d-8e58-a6531d6dd6fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:22.730359 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-267ce997-2bda-4c8d-8e58-a6531d6dd6fd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.096089 Dec 15 14:23:22.730967 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 913/1909] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:22 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:23.072290 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0bcc41f6-9f47-47a7-933e-b0d628e37545 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:23.072910 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0bcc41f6-9f47-47a7-933e-b0d628e37545 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:23.080907 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0bcc41f6-9f47-47a7-933e-b0d628e37545 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:23.081366 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0bcc41f6-9f47-47a7-933e-b0d628e37545 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:23.082212 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0bcc41f6-9f47-47a7-933e-b0d628e37545 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:23.082650 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0bcc41f6-9f47-47a7-933e-b0d628e37545 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:23.235378 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0bcc41f6-9f47-47a7-933e-b0d628e37545 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:23.244538 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0bcc41f6-9f47-47a7-933e-b0d628e37545 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.176383 Dec 15 14:23:23.245134 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 997/1910] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:23 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:23.748936 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-389814fd-b2a6-4b2e-aa71-53b33a39131c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:23.749561 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-389814fd-b2a6-4b2e-aa71-53b33a39131c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:23.757121 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-389814fd-b2a6-4b2e-aa71-53b33a39131c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:23.757469 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-389814fd-b2a6-4b2e-aa71-53b33a39131c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:23.758338 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-389814fd-b2a6-4b2e-aa71-53b33a39131c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:23.758822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-389814fd-b2a6-4b2e-aa71-53b33a39131c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:23.830995 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-389814fd-b2a6-4b2e-aa71-53b33a39131c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:23.839452 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-389814fd-b2a6-4b2e-aa71-53b33a39131c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.094572 Dec 15 14:23:23.840320 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 914/1911] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:23 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:24.263248 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f7a70b84-a89e-4611-9deb-9831710cc5c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:24.264104 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f7a70b84-a89e-4611-9deb-9831710cc5c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:24.272053 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f7a70b84-a89e-4611-9deb-9831710cc5c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:24.272459 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f7a70b84-a89e-4611-9deb-9831710cc5c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:24.273322 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f7a70b84-a89e-4611-9deb-9831710cc5c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:24.273866 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f7a70b84-a89e-4611-9deb-9831710cc5c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:24.428968 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f7a70b84-a89e-4611-9deb-9831710cc5c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:24.439098 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f7a70b84-a89e-4611-9deb-9831710cc5c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.180314 Dec 15 14:23:24.439699 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 998/1912] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:24 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:24.858994 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-79dd12ab-d9f6-4566-9f88-4843d791a1a0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:24.859762 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-79dd12ab-d9f6-4566-9f88-4843d791a1a0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:24.866527 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79dd12ab-d9f6-4566-9f88-4843d791a1a0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:24.867149 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79dd12ab-d9f6-4566-9f88-4843d791a1a0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:24.867960 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79dd12ab-d9f6-4566-9f88-4843d791a1a0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:24.868381 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79dd12ab-d9f6-4566-9f88-4843d791a1a0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:24.941428 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-79dd12ab-d9f6-4566-9f88-4843d791a1a0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:24.952822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-79dd12ab-d9f6-4566-9f88-4843d791a1a0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.097688 Dec 15 14:23:24.953415 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 915/1913] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:24 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:25.458550 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6cc975b3-446d-48bf-8e0f-c5ca8ff418f3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:25.459225 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6cc975b3-446d-48bf-8e0f-c5ca8ff418f3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:25.466522 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6cc975b3-446d-48bf-8e0f-c5ca8ff418f3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:25.466972 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6cc975b3-446d-48bf-8e0f-c5ca8ff418f3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:25.467764 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6cc975b3-446d-48bf-8e0f-c5ca8ff418f3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:25.468231 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6cc975b3-446d-48bf-8e0f-c5ca8ff418f3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:25.622943 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6cc975b3-446d-48bf-8e0f-c5ca8ff418f3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:25.632140 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6cc975b3-446d-48bf-8e0f-c5ca8ff418f3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.177860 Dec 15 14:23:25.632734 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 999/1914] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:25 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:25.970714 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2834ae65-bffe-4843-aa12-ffdee292fd6c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:25.971334 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2834ae65-bffe-4843-aa12-ffdee292fd6c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:25.978552 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2834ae65-bffe-4843-aa12-ffdee292fd6c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:25.979035 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2834ae65-bffe-4843-aa12-ffdee292fd6c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:25.980172 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2834ae65-bffe-4843-aa12-ffdee292fd6c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:25.980683 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2834ae65-bffe-4843-aa12-ffdee292fd6c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:26.050794 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2834ae65-bffe-4843-aa12-ffdee292fd6c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:26.062792 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2834ae65-bffe-4843-aa12-ffdee292fd6c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.095763 Dec 15 14:23:26.063534 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 916/1915] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:25 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:26.652072 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f5764b9b-7a3a-43fa-87ce-c7eab1723377 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:26.652701 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f5764b9b-7a3a-43fa-87ce-c7eab1723377 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:26.663116 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5764b9b-7a3a-43fa-87ce-c7eab1723377 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:26.663568 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5764b9b-7a3a-43fa-87ce-c7eab1723377 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:26.664772 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5764b9b-7a3a-43fa-87ce-c7eab1723377 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:26.665326 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5764b9b-7a3a-43fa-87ce-c7eab1723377 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:26.876717 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f5764b9b-7a3a-43fa-87ce-c7eab1723377 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:26.885324 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f5764b9b-7a3a-43fa-87ce-c7eab1723377 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.238557 Dec 15 14:23:26.886012 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1000/1916] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:26 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:27.085337 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ab6bc340-4576-4c71-9f56-886364b9923c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:27.085985 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ab6bc340-4576-4c71-9f56-886364b9923c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:27.094442 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab6bc340-4576-4c71-9f56-886364b9923c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:27.094899 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab6bc340-4576-4c71-9f56-886364b9923c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:27.095720 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab6bc340-4576-4c71-9f56-886364b9923c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:27.096148 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab6bc340-4576-4c71-9f56-886364b9923c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:27.168143 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ab6bc340-4576-4c71-9f56-886364b9923c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:27.177593 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ab6bc340-4576-4c71-9f56-886364b9923c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.096877 Dec 15 14:23:27.178229 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 917/1917] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:27 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:27.905106 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-952275f5-276d-47ac-90c2-4c82242641e8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:27.905740 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-952275f5-276d-47ac-90c2-4c82242641e8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:27.913309 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-952275f5-276d-47ac-90c2-4c82242641e8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:27.913925 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-952275f5-276d-47ac-90c2-4c82242641e8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:27.915349 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-952275f5-276d-47ac-90c2-4c82242641e8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:27.915996 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-952275f5-276d-47ac-90c2-4c82242641e8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:28.060735 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-952275f5-276d-47ac-90c2-4c82242641e8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:28.068908 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-952275f5-276d-47ac-90c2-4c82242641e8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.169250 Dec 15 14:23:28.070329 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1001/1918] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:27 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:28.197293 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b6df6946-897b-4738-8147-77d741f16b70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:28.198045 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b6df6946-897b-4738-8147-77d741f16b70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:28.205536 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6df6946-897b-4738-8147-77d741f16b70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:28.206022 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6df6946-897b-4738-8147-77d741f16b70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:28.206822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6df6946-897b-4738-8147-77d741f16b70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:28.207335 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6df6946-897b-4738-8147-77d741f16b70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:28.272629 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b6df6946-897b-4738-8147-77d741f16b70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:28.281434 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b6df6946-897b-4738-8147-77d741f16b70 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.088108 Dec 15 14:23:28.282158 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 918/1919] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:28 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:29.068651 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:23:29.069216 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:23:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:23:29.088952 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d192be84-a78e-4ee4-8375-583933781d54 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:29.089588 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d192be84-a78e-4ee4-8375-583933781d54 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:29.097744 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d192be84-a78e-4ee4-8375-583933781d54 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:29.098253 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d192be84-a78e-4ee4-8375-583933781d54 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:29.099036 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d192be84-a78e-4ee4-8375-583933781d54 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:29.099448 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d192be84-a78e-4ee4-8375-583933781d54 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:29.247265 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d192be84-a78e-4ee4-8375-583933781d54 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:29.257159 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d192be84-a78e-4ee4-8375-583933781d54 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.173232 Dec 15 14:23:29.257790 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1002/1920] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:29 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:29.298944 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e809c54b-21cd-4baf-8b7d-749956ebc7f5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:29.299512 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e809c54b-21cd-4baf-8b7d-749956ebc7f5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:29.306301 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e809c54b-21cd-4baf-8b7d-749956ebc7f5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:29.306750 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e809c54b-21cd-4baf-8b7d-749956ebc7f5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:29.307533 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e809c54b-21cd-4baf-8b7d-749956ebc7f5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:29.307964 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e809c54b-21cd-4baf-8b7d-749956ebc7f5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:29.374956 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e809c54b-21cd-4baf-8b7d-749956ebc7f5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:29.383221 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e809c54b-21cd-4baf-8b7d-749956ebc7f5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.088224 Dec 15 14:23:29.383788 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 919/1921] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:29 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:30.277591 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e20e60b1-2050-4e6b-80f8-c0ce365ba806 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:30.278398 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e20e60b1-2050-4e6b-80f8-c0ce365ba806 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:30.287308 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e20e60b1-2050-4e6b-80f8-c0ce365ba806 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:30.287763 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e20e60b1-2050-4e6b-80f8-c0ce365ba806 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:30.288546 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e20e60b1-2050-4e6b-80f8-c0ce365ba806 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:30.288977 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e20e60b1-2050-4e6b-80f8-c0ce365ba806 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:30.401815 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6155958b-9c80-465b-8faa-4741ece03f22 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:30.402478 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6155958b-9c80-465b-8faa-4741ece03f22 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:30.408959 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6155958b-9c80-465b-8faa-4741ece03f22 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:30.409407 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6155958b-9c80-465b-8faa-4741ece03f22 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:30.410236 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6155958b-9c80-465b-8faa-4741ece03f22 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:30.410681 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6155958b-9c80-465b-8faa-4741ece03f22 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:30.436357 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e20e60b1-2050-4e6b-80f8-c0ce365ba806 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:30.445306 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e20e60b1-2050-4e6b-80f8-c0ce365ba806 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.172258 Dec 15 14:23:30.445938 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1003/1922] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:30 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:30.481859 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6155958b-9c80-465b-8faa-4741ece03f22 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:30.493893 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6155958b-9c80-465b-8faa-4741ece03f22 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.095871 Dec 15 14:23:30.494505 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 920/1923] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:30 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:31.077190 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:23:31.077455 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:23:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:23:31.464380 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7cdbd0dc-2b35-4f2e-9e5b-ed40c3e49e73 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:31.465032 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7cdbd0dc-2b35-4f2e-9e5b-ed40c3e49e73 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:31.471813 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7cdbd0dc-2b35-4f2e-9e5b-ed40c3e49e73 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:31.472279 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7cdbd0dc-2b35-4f2e-9e5b-ed40c3e49e73 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:31.473062 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7cdbd0dc-2b35-4f2e-9e5b-ed40c3e49e73 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:31.473496 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7cdbd0dc-2b35-4f2e-9e5b-ed40c3e49e73 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:31.519856 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-56436940-4e64-438e-992d-1bc776e3346f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:31.521027 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-56436940-4e64-438e-992d-1bc776e3346f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:31.530146 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56436940-4e64-438e-992d-1bc776e3346f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:31.530601 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56436940-4e64-438e-992d-1bc776e3346f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:31.531408 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56436940-4e64-438e-992d-1bc776e3346f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:31.531845 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56436940-4e64-438e-992d-1bc776e3346f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:31.614509 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-56436940-4e64-438e-992d-1bc776e3346f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:31.622743 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-56436940-4e64-438e-992d-1bc776e3346f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.112581 Dec 15 14:23:31.623338 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 921/1924] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:31 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:31.657114 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7cdbd0dc-2b35-4f2e-9e5b-ed40c3e49e73 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:31.665706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7cdbd0dc-2b35-4f2e-9e5b-ed40c3e49e73 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.205100 Dec 15 14:23:31.666456 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1004/1925] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:31 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:32.640577 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2d619968-ba8f-4dab-8915-31437bca75cd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:32.641300 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2d619968-ba8f-4dab-8915-31437bca75cd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:32.648575 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d619968-ba8f-4dab-8915-31437bca75cd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:32.649028 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d619968-ba8f-4dab-8915-31437bca75cd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:32.649883 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d619968-ba8f-4dab-8915-31437bca75cd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:32.650325 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d619968-ba8f-4dab-8915-31437bca75cd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:32.686635 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d2bf27d4-a25f-4041-9100-81b4ff5c4793 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:32.687756 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d2bf27d4-a25f-4041-9100-81b4ff5c4793 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:32.696405 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2bf27d4-a25f-4041-9100-81b4ff5c4793 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:32.697065 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2bf27d4-a25f-4041-9100-81b4ff5c4793 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:32.697909 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2bf27d4-a25f-4041-9100-81b4ff5c4793 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:32.698648 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2bf27d4-a25f-4041-9100-81b4ff5c4793 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:32.720526 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2d619968-ba8f-4dab-8915-31437bca75cd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:32.728584 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2d619968-ba8f-4dab-8915-31437bca75cd tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.091842 Dec 15 14:23:32.729195 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 922/1926] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:32 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:32.857345 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d2bf27d4-a25f-4041-9100-81b4ff5c4793 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:32.867056 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d2bf27d4-a25f-4041-9100-81b4ff5c4793 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.186361 Dec 15 14:23:32.867629 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1005/1927] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:32 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:33.747943 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d79e12aa-8564-4831-b802-396d996c57e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:33.748610 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d79e12aa-8564-4831-b802-396d996c57e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:33.761967 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d79e12aa-8564-4831-b802-396d996c57e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:33.763081 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d79e12aa-8564-4831-b802-396d996c57e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:33.763520 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d79e12aa-8564-4831-b802-396d996c57e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:33.764258 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d79e12aa-8564-4831-b802-396d996c57e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:33.845058 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d79e12aa-8564-4831-b802-396d996c57e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:33.854070 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d79e12aa-8564-4831-b802-396d996c57e0 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.109800 Dec 15 14:23:33.854689 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 923/1928] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:33 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:33.888718 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5beb1778-e690-42e7-8c14-eaa07a26262a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:33.889358 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5beb1778-e690-42e7-8c14-eaa07a26262a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:33.896781 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5beb1778-e690-42e7-8c14-eaa07a26262a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:33.897636 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5beb1778-e690-42e7-8c14-eaa07a26262a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:33.898750 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5beb1778-e690-42e7-8c14-eaa07a26262a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:33.899200 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5beb1778-e690-42e7-8c14-eaa07a26262a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:34.055019 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5beb1778-e690-42e7-8c14-eaa07a26262a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:34.067283 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5beb1778-e690-42e7-8c14-eaa07a26262a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.182290 Dec 15 14:23:34.067861 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1006/1929] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:33 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:34.873652 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6fe635c0-19c4-499b-ab69-eeb7c14ee6bc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:34.874274 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6fe635c0-19c4-499b-ab69-eeb7c14ee6bc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:34.882721 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fe635c0-19c4-499b-ab69-eeb7c14ee6bc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:34.883167 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fe635c0-19c4-499b-ab69-eeb7c14ee6bc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:34.883962 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fe635c0-19c4-499b-ab69-eeb7c14ee6bc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:34.884390 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fe635c0-19c4-499b-ab69-eeb7c14ee6bc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:34.950228 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6fe635c0-19c4-499b-ab69-eeb7c14ee6bc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:34.957786 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6fe635c0-19c4-499b-ab69-eeb7c14ee6bc tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.088128 Dec 15 14:23:34.958360 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 924/1930] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:34 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:23:35.085791 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2f31b602-7135-494b-a583-9902a8f143e3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:35.086544 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2f31b602-7135-494b-a583-9902a8f143e3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:35.093156 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f31b602-7135-494b-a583-9902a8f143e3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:35.093643 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f31b602-7135-494b-a583-9902a8f143e3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:35.094407 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f31b602-7135-494b-a583-9902a8f143e3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:35.094941 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f31b602-7135-494b-a583-9902a8f143e3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:35.319475 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2f31b602-7135-494b-a583-9902a8f143e3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:35.329118 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2f31b602-7135-494b-a583-9902a8f143e3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.247427 Dec 15 14:23:35.329732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1007/1931] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:35 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:35.976342 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-698b4f10-41be-405f-92b6-22920c453db5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:35.976915 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-698b4f10-41be-405f-92b6-22920c453db5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:35.986097 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-698b4f10-41be-405f-92b6-22920c453db5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:35.986564 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-698b4f10-41be-405f-92b6-22920c453db5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:35.987558 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-698b4f10-41be-405f-92b6-22920c453db5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:35.992038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-698b4f10-41be-405f-92b6-22920c453db5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:36.064768 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-698b4f10-41be-405f-92b6-22920c453db5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:36.075322 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-698b4f10-41be-405f-92b6-22920c453db5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.103844 Dec 15 14:23:36.075952 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 925/1932] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:35 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:36.348618 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-523381d7-f9ef-4f97-b409-72fe61e678e6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:36.349267 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-523381d7-f9ef-4f97-b409-72fe61e678e6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:36.358062 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-523381d7-f9ef-4f97-b409-72fe61e678e6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:36.358693 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-523381d7-f9ef-4f97-b409-72fe61e678e6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:36.359582 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-523381d7-f9ef-4f97-b409-72fe61e678e6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:36.360221 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-523381d7-f9ef-4f97-b409-72fe61e678e6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:36.516977 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-523381d7-f9ef-4f97-b409-72fe61e678e6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:36.525559 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-523381d7-f9ef-4f97-b409-72fe61e678e6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.181938 Dec 15 14:23:36.526178 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1008/1933] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:36 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:37.095750 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3b0822b5-c5e7-4b3f-b2f0-32ec7d6f72d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:37.096383 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3b0822b5-c5e7-4b3f-b2f0-32ec7d6f72d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:37.103304 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b0822b5-c5e7-4b3f-b2f0-32ec7d6f72d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:37.103749 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b0822b5-c5e7-4b3f-b2f0-32ec7d6f72d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:37.104543 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b0822b5-c5e7-4b3f-b2f0-32ec7d6f72d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:37.104978 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b0822b5-c5e7-4b3f-b2f0-32ec7d6f72d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:37.170271 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3b0822b5-c5e7-4b3f-b2f0-32ec7d6f72d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:37.179319 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3b0822b5-c5e7-4b3f-b2f0-32ec7d6f72d3 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.087166 Dec 15 14:23:37.180065 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 926/1934] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:37 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:37.543059 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d3408ad7-b140-46a3-af35-78b291b21bb9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:37.543682 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d3408ad7-b140-46a3-af35-78b291b21bb9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:37.550732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3408ad7-b140-46a3-af35-78b291b21bb9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:37.551448 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3408ad7-b140-46a3-af35-78b291b21bb9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:37.552004 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3408ad7-b140-46a3-af35-78b291b21bb9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:37.552475 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3408ad7-b140-46a3-af35-78b291b21bb9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:37.713529 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d3408ad7-b140-46a3-af35-78b291b21bb9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:37.722745 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d3408ad7-b140-46a3-af35-78b291b21bb9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.183471 Dec 15 14:23:37.723374 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1009/1935] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:37 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:38.199262 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3beb67e3-22e6-4fb3-ab74-0cde453167e2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:38.199967 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3beb67e3-22e6-4fb3-ab74-0cde453167e2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:38.206664 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3beb67e3-22e6-4fb3-ab74-0cde453167e2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:38.207116 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3beb67e3-22e6-4fb3-ab74-0cde453167e2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:38.207908 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3beb67e3-22e6-4fb3-ab74-0cde453167e2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:38.208344 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3beb67e3-22e6-4fb3-ab74-0cde453167e2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:38.285261 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3beb67e3-22e6-4fb3-ab74-0cde453167e2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:38.296236 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3beb67e3-22e6-4fb3-ab74-0cde453167e2 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.101461 Dec 15 14:23:38.297241 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 927/1936] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:38 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:38.741272 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cdd7fa35-1b48-445f-88ee-fcfa00fab0e9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:38.742007 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cdd7fa35-1b48-445f-88ee-fcfa00fab0e9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:38.749003 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cdd7fa35-1b48-445f-88ee-fcfa00fab0e9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:38.749452 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cdd7fa35-1b48-445f-88ee-fcfa00fab0e9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:38.750301 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cdd7fa35-1b48-445f-88ee-fcfa00fab0e9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:38.750732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cdd7fa35-1b48-445f-88ee-fcfa00fab0e9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:38.914754 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cdd7fa35-1b48-445f-88ee-fcfa00fab0e9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:38.923843 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cdd7fa35-1b48-445f-88ee-fcfa00fab0e9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.186198 Dec 15 14:23:38.924439 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1010/1937] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:38 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:39.314404 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-67b7b545-1104-4578-b7fa-a9a09463641e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:39.315203 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-67b7b545-1104-4578-b7fa-a9a09463641e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:39.323237 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67b7b545-1104-4578-b7fa-a9a09463641e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:39.323795 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67b7b545-1104-4578-b7fa-a9a09463641e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:39.324649 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67b7b545-1104-4578-b7fa-a9a09463641e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:39.325263 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67b7b545-1104-4578-b7fa-a9a09463641e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:39.393986 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-67b7b545-1104-4578-b7fa-a9a09463641e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:39.402412 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-67b7b545-1104-4578-b7fa-a9a09463641e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.091796 Dec 15 14:23:39.403056 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 928/1938] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:39 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:39.949151 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-eb7f1b61-9110-4427-96c6-a3928f31897d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:39.949786 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-eb7f1b61-9110-4427-96c6-a3928f31897d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:39.956600 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eb7f1b61-9110-4427-96c6-a3928f31897d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:39.957040 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eb7f1b61-9110-4427-96c6-a3928f31897d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:39.957876 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eb7f1b61-9110-4427-96c6-a3928f31897d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:39.958290 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eb7f1b61-9110-4427-96c6-a3928f31897d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:40.113684 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-eb7f1b61-9110-4427-96c6-a3928f31897d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:40.126996 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-eb7f1b61-9110-4427-96c6-a3928f31897d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.181805 Dec 15 14:23:40.127947 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1011/1939] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:39 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:40.420887 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-44c1ba29-b490-4a08-ae48-10665b1d5f51 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:40.421577 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-44c1ba29-b490-4a08-ae48-10665b1d5f51 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:40.428217 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-44c1ba29-b490-4a08-ae48-10665b1d5f51 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:40.428646 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-44c1ba29-b490-4a08-ae48-10665b1d5f51 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:40.429726 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-44c1ba29-b490-4a08-ae48-10665b1d5f51 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:40.430750 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-44c1ba29-b490-4a08-ae48-10665b1d5f51 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:40.496431 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-44c1ba29-b490-4a08-ae48-10665b1d5f51 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:40.504437 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-44c1ba29-b490-4a08-ae48-10665b1d5f51 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.087320 Dec 15 14:23:40.505022 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 929/1940] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:40 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:41.148509 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-116259ee-3dfa-44ef-bddc-3a6a9cbd956d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:41.149446 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-116259ee-3dfa-44ef-bddc-3a6a9cbd956d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:41.156728 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-116259ee-3dfa-44ef-bddc-3a6a9cbd956d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:41.157542 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-116259ee-3dfa-44ef-bddc-3a6a9cbd956d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:41.158727 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-116259ee-3dfa-44ef-bddc-3a6a9cbd956d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:41.159175 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-116259ee-3dfa-44ef-bddc-3a6a9cbd956d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:41.346612 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-116259ee-3dfa-44ef-bddc-3a6a9cbd956d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:41.358693 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-116259ee-3dfa-44ef-bddc-3a6a9cbd956d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.214822 Dec 15 14:23:41.359295 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1012/1941] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:41 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:41.525346 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-342d6174-7fc6-416c-bf69-14068adc2ea1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:41.526038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-342d6174-7fc6-416c-bf69-14068adc2ea1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:41.536083 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-342d6174-7fc6-416c-bf69-14068adc2ea1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:41.536676 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-342d6174-7fc6-416c-bf69-14068adc2ea1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:41.537802 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-342d6174-7fc6-416c-bf69-14068adc2ea1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:41.538357 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-342d6174-7fc6-416c-bf69-14068adc2ea1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:41.639405 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-342d6174-7fc6-416c-bf69-14068adc2ea1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:41.650653 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-342d6174-7fc6-416c-bf69-14068adc2ea1 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.131466 Dec 15 14:23:41.651681 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 930/1942] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:41 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:42.376867 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d53be9e6-bcd9-47de-aad5-a105e1b3cb57 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:42.377503 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d53be9e6-bcd9-47de-aad5-a105e1b3cb57 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:42.385316 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d53be9e6-bcd9-47de-aad5-a105e1b3cb57 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:42.385888 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d53be9e6-bcd9-47de-aad5-a105e1b3cb57 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:42.386742 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d53be9e6-bcd9-47de-aad5-a105e1b3cb57 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:42.387241 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d53be9e6-bcd9-47de-aad5-a105e1b3cb57 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:42.550325 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d53be9e6-bcd9-47de-aad5-a105e1b3cb57 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:42.561933 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d53be9e6-bcd9-47de-aad5-a105e1b3cb57 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.188795 Dec 15 14:23:42.562670 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1013/1943] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:42 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:42.673011 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-87de472a-dfb8-4fc0-a36c-fced6bfe268c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:42.673740 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-87de472a-dfb8-4fc0-a36c-fced6bfe268c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:42.680598 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87de472a-dfb8-4fc0-a36c-fced6bfe268c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:42.681042 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87de472a-dfb8-4fc0-a36c-fced6bfe268c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:42.681967 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87de472a-dfb8-4fc0-a36c-fced6bfe268c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:42.682408 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87de472a-dfb8-4fc0-a36c-fced6bfe268c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:42.749880 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-87de472a-dfb8-4fc0-a36c-fced6bfe268c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:42.758987 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-87de472a-dfb8-4fc0-a36c-fced6bfe268c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.089833 Dec 15 14:23:42.759559 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 931/1944] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:42 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:43.581996 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b8e763fc-390f-47f8-9ea8-6bcfeb80c8b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:43.582780 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b8e763fc-390f-47f8-9ea8-6bcfeb80c8b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:43.589890 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8e763fc-390f-47f8-9ea8-6bcfeb80c8b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:43.590339 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8e763fc-390f-47f8-9ea8-6bcfeb80c8b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:43.591140 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8e763fc-390f-47f8-9ea8-6bcfeb80c8b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:43.591577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8e763fc-390f-47f8-9ea8-6bcfeb80c8b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:43.739210 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b8e763fc-390f-47f8-9ea8-6bcfeb80c8b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:43.750991 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b8e763fc-390f-47f8-9ea8-6bcfeb80c8b9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.172635 Dec 15 14:23:43.751909 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1014/1945] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:43 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:23:43.777045 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9fcc705c-e2b6-4fbf-bd1e-fcc664332fbe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:43.777797 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9fcc705c-e2b6-4fbf-bd1e-fcc664332fbe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:43.784645 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fcc705c-e2b6-4fbf-bd1e-fcc664332fbe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:43.785098 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fcc705c-e2b6-4fbf-bd1e-fcc664332fbe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:43.785932 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fcc705c-e2b6-4fbf-bd1e-fcc664332fbe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:43.786365 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fcc705c-e2b6-4fbf-bd1e-fcc664332fbe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:43.861860 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9fcc705c-e2b6-4fbf-bd1e-fcc664332fbe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:43.869874 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9fcc705c-e2b6-4fbf-bd1e-fcc664332fbe tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.097451 Dec 15 14:23:43.870446 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 932/1946] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:43 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:44.769078 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-24ef455e-c191-43b6-8884-2e61db0c3c18 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:44.769711 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-24ef455e-c191-43b6-8884-2e61db0c3c18 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:44.777479 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24ef455e-c191-43b6-8884-2e61db0c3c18 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:44.777955 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24ef455e-c191-43b6-8884-2e61db0c3c18 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:44.779083 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24ef455e-c191-43b6-8884-2e61db0c3c18 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:44.779218 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24ef455e-c191-43b6-8884-2e61db0c3c18 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:44.887657 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-99d59789-b77a-4a9a-a3b4-92131a98fcef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:44.888269 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-99d59789-b77a-4a9a-a3b4-92131a98fcef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:44.895187 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99d59789-b77a-4a9a-a3b4-92131a98fcef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:44.895626 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99d59789-b77a-4a9a-a3b4-92131a98fcef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:44.896627 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99d59789-b77a-4a9a-a3b4-92131a98fcef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:44.897260 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99d59789-b77a-4a9a-a3b4-92131a98fcef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:44.924399 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-24ef455e-c191-43b6-8884-2e61db0c3c18 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:44.934138 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-24ef455e-c191-43b6-8884-2e61db0c3c18 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.168762 Dec 15 14:23:44.934742 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1015/1947] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:44 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:44.970044 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-99d59789-b77a-4a9a-a3b4-92131a98fcef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:44.978681 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-99d59789-b77a-4a9a-a3b4-92131a98fcef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.094617 Dec 15 14:23:44.979247 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 933/1948] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:44 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:45.953386 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c017c205-1ad1-4067-827e-843bfb451b5c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:45.954005 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c017c205-1ad1-4067-827e-843bfb451b5c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:45.960540 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c017c205-1ad1-4067-827e-843bfb451b5c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:45.960989 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c017c205-1ad1-4067-827e-843bfb451b5c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:45.961806 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c017c205-1ad1-4067-827e-843bfb451b5c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:45.962234 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c017c205-1ad1-4067-827e-843bfb451b5c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:45.995967 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-aa4392a8-e1b7-4cf1-ab0e-29dafb414aab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:45.996750 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-aa4392a8-e1b7-4cf1-ab0e-29dafb414aab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:46.003998 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa4392a8-e1b7-4cf1-ab0e-29dafb414aab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:46.004440 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa4392a8-e1b7-4cf1-ab0e-29dafb414aab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:46.005316 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa4392a8-e1b7-4cf1-ab0e-29dafb414aab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:46.005783 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa4392a8-e1b7-4cf1-ab0e-29dafb414aab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:46.080166 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-aa4392a8-e1b7-4cf1-ab0e-29dafb414aab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:46.089204 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-aa4392a8-e1b7-4cf1-ab0e-29dafb414aab tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.096776 Dec 15 14:23:46.089821 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 934/1949] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:45 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:46.127070 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c017c205-1ad1-4067-827e-843bfb451b5c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:46.136069 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c017c205-1ad1-4067-827e-843bfb451b5c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.186088 Dec 15 14:23:46.136671 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1016/1950] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:45 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:47.110587 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6a3b450e-cbda-4f62-ad8f-67a5ad2f2564 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:47.111426 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6a3b450e-cbda-4f62-ad8f-67a5ad2f2564 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:47.122007 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6a3b450e-cbda-4f62-ad8f-67a5ad2f2564 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:47.122464 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6a3b450e-cbda-4f62-ad8f-67a5ad2f2564 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:47.123253 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6a3b450e-cbda-4f62-ad8f-67a5ad2f2564 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:47.123694 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6a3b450e-cbda-4f62-ad8f-67a5ad2f2564 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:47.153911 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b8bdb948-6d54-4e89-b372-bf526e0b0a06 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:47.156722 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b8bdb948-6d54-4e89-b372-bf526e0b0a06 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:47.163623 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8bdb948-6d54-4e89-b372-bf526e0b0a06 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:47.164071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8bdb948-6d54-4e89-b372-bf526e0b0a06 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:47.164861 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8bdb948-6d54-4e89-b372-bf526e0b0a06 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:47.165294 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8bdb948-6d54-4e89-b372-bf526e0b0a06 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:47.186018 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6a3b450e-cbda-4f62-ad8f-67a5ad2f2564 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:47.193431 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6a3b450e-cbda-4f62-ad8f-67a5ad2f2564 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.089357 Dec 15 14:23:47.194213 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 935/1951] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:47 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:47.590070 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b8bdb948-6d54-4e89-b372-bf526e0b0a06 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:47.602110 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b8bdb948-6d54-4e89-b372-bf526e0b0a06 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.452331 Dec 15 14:23:47.602918 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1017/1952] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:47 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:48.210779 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4bf87560-c47c-4a2b-b328-9483c2620608 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:48.211418 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4bf87560-c47c-4a2b-b328-9483c2620608 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:48.219487 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4bf87560-c47c-4a2b-b328-9483c2620608 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:48.219942 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4bf87560-c47c-4a2b-b328-9483c2620608 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:48.220732 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4bf87560-c47c-4a2b-b328-9483c2620608 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:48.221168 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4bf87560-c47c-4a2b-b328-9483c2620608 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:48.294211 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4bf87560-c47c-4a2b-b328-9483c2620608 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:48.306018 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4bf87560-c47c-4a2b-b328-9483c2620608 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.098746 Dec 15 14:23:48.306781 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 936/1953] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:48 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:48.622417 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-85687c26-5193-4e99-95c8-af713e08b103 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:48.623039 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-85687c26-5193-4e99-95c8-af713e08b103 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:48.630245 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85687c26-5193-4e99-95c8-af713e08b103 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:48.630700 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85687c26-5193-4e99-95c8-af713e08b103 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:48.631536 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85687c26-5193-4e99-95c8-af713e08b103 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:48.631970 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85687c26-5193-4e99-95c8-af713e08b103 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:48.778639 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-85687c26-5193-4e99-95c8-af713e08b103 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:48.792166 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-85687c26-5193-4e99-95c8-af713e08b103 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.174403 Dec 15 14:23:48.792741 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1018/1954] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:48 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:49.329291 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5ff26f95-785a-4566-a2e4-511f84b9db5e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:49.330063 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5ff26f95-785a-4566-a2e4-511f84b9db5e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:49.336762 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ff26f95-785a-4566-a2e4-511f84b9db5e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:49.337208 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ff26f95-785a-4566-a2e4-511f84b9db5e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:49.338195 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ff26f95-785a-4566-a2e4-511f84b9db5e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:49.338638 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ff26f95-785a-4566-a2e4-511f84b9db5e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:49.414845 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5ff26f95-785a-4566-a2e4-511f84b9db5e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:49.423630 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5ff26f95-785a-4566-a2e4-511f84b9db5e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.098196 Dec 15 14:23:49.424199 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 937/1955] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:49 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:49.812464 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7f84b815-8ac1-41c7-9c85-879d52f9a8a3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:49.813075 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7f84b815-8ac1-41c7-9c85-879d52f9a8a3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:49.819726 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7f84b815-8ac1-41c7-9c85-879d52f9a8a3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:49.820180 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7f84b815-8ac1-41c7-9c85-879d52f9a8a3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:49.820959 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7f84b815-8ac1-41c7-9c85-879d52f9a8a3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:49.821428 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7f84b815-8ac1-41c7-9c85-879d52f9a8a3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:49.974056 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7f84b815-8ac1-41c7-9c85-879d52f9a8a3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:49.985440 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7f84b815-8ac1-41c7-9c85-879d52f9a8a3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.177836 Dec 15 14:23:49.986217 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1019/1956] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:49 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:50.442406 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6eeae954-6851-4ec0-8b5d-ecfb4f75ea51 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:50.443010 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6eeae954-6851-4ec0-8b5d-ecfb4f75ea51 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:50.450483 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6eeae954-6851-4ec0-8b5d-ecfb4f75ea51 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:50.451424 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6eeae954-6851-4ec0-8b5d-ecfb4f75ea51 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:50.452230 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6eeae954-6851-4ec0-8b5d-ecfb4f75ea51 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:50.452674 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6eeae954-6851-4ec0-8b5d-ecfb4f75ea51 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:50.517905 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6eeae954-6851-4ec0-8b5d-ecfb4f75ea51 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:50.529072 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6eeae954-6851-4ec0-8b5d-ecfb4f75ea51 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.090292 Dec 15 14:23:50.530012 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 938/1957] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:50 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:51.007404 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ce2239fe-d0a2-4f3e-9b9a-b46c08aea3ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:51.008028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ce2239fe-d0a2-4f3e-9b9a-b46c08aea3ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:51.015216 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce2239fe-d0a2-4f3e-9b9a-b46c08aea3ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:51.015657 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce2239fe-d0a2-4f3e-9b9a-b46c08aea3ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:51.016425 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce2239fe-d0a2-4f3e-9b9a-b46c08aea3ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:51.016869 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce2239fe-d0a2-4f3e-9b9a-b46c08aea3ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:51.170435 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ce2239fe-d0a2-4f3e-9b9a-b46c08aea3ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:51.179378 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ce2239fe-d0a2-4f3e-9b9a-b46c08aea3ca tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.176079 Dec 15 14:23:51.179962 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1020/1958] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:51 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:51.554614 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c4d34d35-9d33-400c-b644-e07bad1533ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:51.555603 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c4d34d35-9d33-400c-b644-e07bad1533ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:51.564126 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4d34d35-9d33-400c-b644-e07bad1533ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:51.564582 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4d34d35-9d33-400c-b644-e07bad1533ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:51.565355 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4d34d35-9d33-400c-b644-e07bad1533ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:51.565820 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4d34d35-9d33-400c-b644-e07bad1533ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:51.631305 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c4d34d35-9d33-400c-b644-e07bad1533ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:51.639906 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c4d34d35-9d33-400c-b644-e07bad1533ef tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.091524 Dec 15 14:23:51.640500 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 939/1959] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:51 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:52.208390 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f13835e0-ee0d-436d-8f5d-35c217495ed7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:52.209025 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f13835e0-ee0d-436d-8f5d-35c217495ed7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:52.216185 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f13835e0-ee0d-436d-8f5d-35c217495ed7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:52.216650 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f13835e0-ee0d-436d-8f5d-35c217495ed7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:52.217445 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f13835e0-ee0d-436d-8f5d-35c217495ed7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:52.217918 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f13835e0-ee0d-436d-8f5d-35c217495ed7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:52.371429 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f13835e0-ee0d-436d-8f5d-35c217495ed7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:52.380912 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f13835e0-ee0d-436d-8f5d-35c217495ed7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.176399 Dec 15 14:23:52.381496 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1021/1960] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:52 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:52.662742 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-73c876d9-5ddc-45c8-b48f-6a5013351299 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:52.663398 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-73c876d9-5ddc-45c8-b48f-6a5013351299 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:52.671180 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73c876d9-5ddc-45c8-b48f-6a5013351299 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:52.671621 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73c876d9-5ddc-45c8-b48f-6a5013351299 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:52.672401 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73c876d9-5ddc-45c8-b48f-6a5013351299 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:52.672829 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73c876d9-5ddc-45c8-b48f-6a5013351299 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:52.746060 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-73c876d9-5ddc-45c8-b48f-6a5013351299 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:52.758254 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-73c876d9-5ddc-45c8-b48f-6a5013351299 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.099033 Dec 15 14:23:52.758951 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 940/1961] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:52 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:53.401542 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ea9a7b54-52e2-408b-9c4f-96b99d64ff1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:53.402457 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ea9a7b54-52e2-408b-9c4f-96b99d64ff1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:53.412000 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea9a7b54-52e2-408b-9c4f-96b99d64ff1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:53.412615 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea9a7b54-52e2-408b-9c4f-96b99d64ff1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:53.414069 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea9a7b54-52e2-408b-9c4f-96b99d64ff1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:53.414700 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea9a7b54-52e2-408b-9c4f-96b99d64ff1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:53.562303 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ea9a7b54-52e2-408b-9c4f-96b99d64ff1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:53.571288 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ea9a7b54-52e2-408b-9c4f-96b99d64ff1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.175325 Dec 15 14:23:53.572374 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1022/1962] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:53 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:53.779758 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-96f373be-9962-4452-9bbc-d3e4a110bee7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:53.780333 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-96f373be-9962-4452-9bbc-d3e4a110bee7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:53.787016 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96f373be-9962-4452-9bbc-d3e4a110bee7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:53.787468 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96f373be-9962-4452-9bbc-d3e4a110bee7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:53.788261 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96f373be-9962-4452-9bbc-d3e4a110bee7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:53.788702 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96f373be-9962-4452-9bbc-d3e4a110bee7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:53.858583 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-96f373be-9962-4452-9bbc-d3e4a110bee7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:53.866813 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-96f373be-9962-4452-9bbc-d3e4a110bee7 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.093073 Dec 15 14:23:53.867419 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 941/1963] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:53 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:54.590622 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-775a3774-726b-44e9-8068-9a2dbb3a45bc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:54.591249 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-775a3774-726b-44e9-8068-9a2dbb3a45bc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:54.598362 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-775a3774-726b-44e9-8068-9a2dbb3a45bc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:54.598808 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-775a3774-726b-44e9-8068-9a2dbb3a45bc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:54.599594 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-775a3774-726b-44e9-8068-9a2dbb3a45bc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:54.600030 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-775a3774-726b-44e9-8068-9a2dbb3a45bc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:54.739943 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-775a3774-726b-44e9-8068-9a2dbb3a45bc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:54.748480 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-775a3774-726b-44e9-8068-9a2dbb3a45bc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.161638 Dec 15 14:23:54.749069 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1023/1964] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:54 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:54.887694 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cdbc0a11-e2fd-4bc2-a782-dc2ba8c57840 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:54.888299 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cdbc0a11-e2fd-4bc2-a782-dc2ba8c57840 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:54.895700 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cdbc0a11-e2fd-4bc2-a782-dc2ba8c57840 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:54.896152 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cdbc0a11-e2fd-4bc2-a782-dc2ba8c57840 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:54.896947 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cdbc0a11-e2fd-4bc2-a782-dc2ba8c57840 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:54.897384 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cdbc0a11-e2fd-4bc2-a782-dc2ba8c57840 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:54.970293 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cdbc0a11-e2fd-4bc2-a782-dc2ba8c57840 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:54.978423 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cdbc0a11-e2fd-4bc2-a782-dc2ba8c57840 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.097006 Dec 15 14:23:54.978977 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 942/1965] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:54 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:55.765651 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f7874e25-1230-4a8f-a34c-9db09d3dcb35 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:55.766424 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f7874e25-1230-4a8f-a34c-9db09d3dcb35 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:55.773309 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f7874e25-1230-4a8f-a34c-9db09d3dcb35 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:55.773785 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f7874e25-1230-4a8f-a34c-9db09d3dcb35 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:55.774569 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f7874e25-1230-4a8f-a34c-9db09d3dcb35 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:55.774991 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f7874e25-1230-4a8f-a34c-9db09d3dcb35 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:55.917783 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f7874e25-1230-4a8f-a34c-9db09d3dcb35 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:55.926973 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f7874e25-1230-4a8f-a34c-9db09d3dcb35 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.165164 Dec 15 14:23:55.927556 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1024/1966] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:55 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:55.996290 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-337a61f0-b162-42f6-9a8f-fb0b372bc64f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:55.996901 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-337a61f0-b162-42f6-9a8f-fb0b372bc64f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:56.004336 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-337a61f0-b162-42f6-9a8f-fb0b372bc64f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:56.004842 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-337a61f0-b162-42f6-9a8f-fb0b372bc64f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:56.005645 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-337a61f0-b162-42f6-9a8f-fb0b372bc64f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:56.006119 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-337a61f0-b162-42f6-9a8f-fb0b372bc64f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:56.076533 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-337a61f0-b162-42f6-9a8f-fb0b372bc64f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:56.085038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-337a61f0-b162-42f6-9a8f-fb0b372bc64f tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.092621 Dec 15 14:23:56.085641 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 943/1967] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:55 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:56.948802 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ce6d4a73-954e-44b3-8e95-ad1e4f0d9c70 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:56.949575 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ce6d4a73-954e-44b3-8e95-ad1e4f0d9c70 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:56.957915 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce6d4a73-954e-44b3-8e95-ad1e4f0d9c70 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:56.958368 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce6d4a73-954e-44b3-8e95-ad1e4f0d9c70 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:56.959348 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce6d4a73-954e-44b3-8e95-ad1e4f0d9c70 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:56.959775 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce6d4a73-954e-44b3-8e95-ad1e4f0d9c70 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:57.102304 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d0b47cda-7815-42d8-81f3-f17a1abdc6db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:57.102899 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d0b47cda-7815-42d8-81f3-f17a1abdc6db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:57.109503 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0b47cda-7815-42d8-81f3-f17a1abdc6db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:57.110400 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0b47cda-7815-42d8-81f3-f17a1abdc6db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:57.111072 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0b47cda-7815-42d8-81f3-f17a1abdc6db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:57.111602 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0b47cda-7815-42d8-81f3-f17a1abdc6db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:57.115999 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ce6d4a73-954e-44b3-8e95-ad1e4f0d9c70 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:57.125708 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ce6d4a73-954e-44b3-8e95-ad1e4f0d9c70 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.182896 Dec 15 14:23:57.126645 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1025/1968] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:56 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:57.182043 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d0b47cda-7815-42d8-81f3-f17a1abdc6db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:57.190703 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d0b47cda-7815-42d8-81f3-f17a1abdc6db tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.092148 Dec 15 14:23:57.193332 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 944/1969] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:57 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:58.144994 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8cb8cf83-71b2-42c0-a0ee-1505f6a251eb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:58.145583 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8cb8cf83-71b2-42c0-a0ee-1505f6a251eb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:58.153490 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8cb8cf83-71b2-42c0-a0ee-1505f6a251eb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:58.153976 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8cb8cf83-71b2-42c0-a0ee-1505f6a251eb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:58.154756 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8cb8cf83-71b2-42c0-a0ee-1505f6a251eb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:58.155188 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8cb8cf83-71b2-42c0-a0ee-1505f6a251eb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:58.213709 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ab79f1df-92e9-47b6-b069-04307f1ecde4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:58.214335 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ab79f1df-92e9-47b6-b069-04307f1ecde4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:58.221551 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab79f1df-92e9-47b6-b069-04307f1ecde4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:58.222067 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab79f1df-92e9-47b6-b069-04307f1ecde4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:58.222894 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab79f1df-92e9-47b6-b069-04307f1ecde4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:58.223329 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab79f1df-92e9-47b6-b069-04307f1ecde4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:58.294636 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ab79f1df-92e9-47b6-b069-04307f1ecde4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:58.302942 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ab79f1df-92e9-47b6-b069-04307f1ecde4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.092944 Dec 15 14:23:58.303515 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 945/1970] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:58 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:58.323792 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8cb8cf83-71b2-42c0-a0ee-1505f6a251eb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:58.332641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8cb8cf83-71b2-42c0-a0ee-1505f6a251eb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.192400 Dec 15 14:23:58.333207 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1026/1971] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:58 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:59.321140 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3807a39c-9b3d-43a8-b621-1b0e0a456c25 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:59.321817 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3807a39c-9b3d-43a8-b621-1b0e0a456c25 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:59.328975 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3807a39c-9b3d-43a8-b621-1b0e0a456c25 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:59.329431 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3807a39c-9b3d-43a8-b621-1b0e0a456c25 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:59.330297 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3807a39c-9b3d-43a8-b621-1b0e0a456c25 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:59.330740 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3807a39c-9b3d-43a8-b621-1b0e0a456c25 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:59.350928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f53a2622-9891-439f-a6af-272f504d6103 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:59.351571 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f53a2622-9891-439f-a6af-272f504d6103 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:59.358343 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f53a2622-9891-439f-a6af-272f504d6103 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:59.358800 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f53a2622-9891-439f-a6af-272f504d6103 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:59.359583 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f53a2622-9891-439f-a6af-272f504d6103 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:59.360037 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f53a2622-9891-439f-a6af-272f504d6103 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:59.396234 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3807a39c-9b3d-43a8-b621-1b0e0a456c25 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:59.404158 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3807a39c-9b3d-43a8-b621-1b0e0a456c25 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.087204 Dec 15 14:23:59.404711 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 946/1972] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:59 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:59.508327 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f53a2622-9891-439f-a6af-272f504d6103 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:59.521140 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f53a2622-9891-439f-a6af-272f504d6103 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.173975 Dec 15 14:23:59.522099 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1027/1973] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:59 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:24:00.421555 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2a5ed920-5a18-4bfb-ae4d-9663d0b84835 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:00.422253 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2a5ed920-5a18-4bfb-ae4d-9663d0b84835 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:00.429523 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a5ed920-5a18-4bfb-ae4d-9663d0b84835 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:00.430163 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a5ed920-5a18-4bfb-ae4d-9663d0b84835 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:00.430988 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a5ed920-5a18-4bfb-ae4d-9663d0b84835 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:00.431432 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a5ed920-5a18-4bfb-ae4d-9663d0b84835 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:00.500938 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2a5ed920-5a18-4bfb-ae4d-9663d0b84835 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:00.512525 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2a5ed920-5a18-4bfb-ae4d-9663d0b84835 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.094214 Dec 15 14:24:00.513606 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 947/1974] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:00 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:00.538632 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1fd444f6-4717-48d0-a8b6-238fb8ebe7b5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:00.539364 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1fd444f6-4717-48d0-a8b6-238fb8ebe7b5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:00.546244 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1fd444f6-4717-48d0-a8b6-238fb8ebe7b5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:00.546698 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1fd444f6-4717-48d0-a8b6-238fb8ebe7b5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:00.547467 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1fd444f6-4717-48d0-a8b6-238fb8ebe7b5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:00.547900 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1fd444f6-4717-48d0-a8b6-238fb8ebe7b5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:00.698631 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1fd444f6-4717-48d0-a8b6-238fb8ebe7b5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:00.707028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1fd444f6-4717-48d0-a8b6-238fb8ebe7b5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.172099 Dec 15 14:24:00.707650 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1028/1975] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:00 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:01.530862 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6866c49e-4de7-4435-a6bc-98c222b42c98 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:01.531478 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6866c49e-4de7-4435-a6bc-98c222b42c98 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:01.538965 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6866c49e-4de7-4435-a6bc-98c222b42c98 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:01.539404 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6866c49e-4de7-4435-a6bc-98c222b42c98 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:01.540209 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6866c49e-4de7-4435-a6bc-98c222b42c98 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:01.540637 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6866c49e-4de7-4435-a6bc-98c222b42c98 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:01.608156 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6866c49e-4de7-4435-a6bc-98c222b42c98 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:01.620016 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6866c49e-4de7-4435-a6bc-98c222b42c98 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.092572 Dec 15 14:24:01.620860 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 948/1976] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:01 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:01.725705 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-471fbbf4-e736-4d22-944f-16b3321d28df tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:01.726333 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-471fbbf4-e736-4d22-944f-16b3321d28df tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:01.733407 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-471fbbf4-e736-4d22-944f-16b3321d28df tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:01.733879 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-471fbbf4-e736-4d22-944f-16b3321d28df tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:01.734679 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-471fbbf4-e736-4d22-944f-16b3321d28df tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:01.735108 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-471fbbf4-e736-4d22-944f-16b3321d28df tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:01.888007 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-471fbbf4-e736-4d22-944f-16b3321d28df tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:01.896494 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-471fbbf4-e736-4d22-944f-16b3321d28df tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.175640 Dec 15 14:24:01.897094 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1029/1977] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:01 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:02.638031 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b7f33569-be9b-4afe-bfa1-221642dfbed5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:02.638656 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b7f33569-be9b-4afe-bfa1-221642dfbed5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:02.645430 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7f33569-be9b-4afe-bfa1-221642dfbed5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:02.645914 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7f33569-be9b-4afe-bfa1-221642dfbed5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:02.646691 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7f33569-be9b-4afe-bfa1-221642dfbed5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:02.647129 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7f33569-be9b-4afe-bfa1-221642dfbed5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:02.723082 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b7f33569-be9b-4afe-bfa1-221642dfbed5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:02.732685 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b7f33569-be9b-4afe-bfa1-221642dfbed5 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.098307 Dec 15 14:24:02.733276 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 949/1978] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:02 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:02.914569 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d1fe44d3-87c1-4ec4-948e-ceafb915d164 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:02.915155 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d1fe44d3-87c1-4ec4-948e-ceafb915d164 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:02.924415 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1fe44d3-87c1-4ec4-948e-ceafb915d164 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:02.924637 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1fe44d3-87c1-4ec4-948e-ceafb915d164 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:02.925412 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1fe44d3-87c1-4ec4-948e-ceafb915d164 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:02.925912 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1fe44d3-87c1-4ec4-948e-ceafb915d164 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:03.077337 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d1fe44d3-87c1-4ec4-948e-ceafb915d164 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:03.086196 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d1fe44d3-87c1-4ec4-948e-ceafb915d164 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.175627 Dec 15 14:24:03.086925 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1030/1979] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:02 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:03.752082 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-05e03601-cbf9-44e8-b5ac-90049ae0db35 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:03.752738 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-05e03601-cbf9-44e8-b5ac-90049ae0db35 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:03.759717 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-05e03601-cbf9-44e8-b5ac-90049ae0db35 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:03.760170 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-05e03601-cbf9-44e8-b5ac-90049ae0db35 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:03.760963 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-05e03601-cbf9-44e8-b5ac-90049ae0db35 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:03.761404 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-05e03601-cbf9-44e8-b5ac-90049ae0db35 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:03.826612 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-05e03601-cbf9-44e8-b5ac-90049ae0db35 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:03.835375 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-05e03601-cbf9-44e8-b5ac-90049ae0db35 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.087143 Dec 15 14:24:03.835962 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 950/1980] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:03 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:04.104306 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5609ad18-56ab-4952-9ba3-1d22cda503d7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:04.104912 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5609ad18-56ab-4952-9ba3-1d22cda503d7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:04.112554 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5609ad18-56ab-4952-9ba3-1d22cda503d7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:04.113007 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5609ad18-56ab-4952-9ba3-1d22cda503d7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:04.113850 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5609ad18-56ab-4952-9ba3-1d22cda503d7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:04.114289 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5609ad18-56ab-4952-9ba3-1d22cda503d7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:04.258877 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5609ad18-56ab-4952-9ba3-1d22cda503d7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:04.267618 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5609ad18-56ab-4952-9ba3-1d22cda503d7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.167116 Dec 15 14:24:04.268227 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1031/1981] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:04 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:04.852659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-11ac8c24-18a8-4fea-ab86-90a62cee3ee8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:04.853304 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-11ac8c24-18a8-4fea-ab86-90a62cee3ee8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:04.859798 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11ac8c24-18a8-4fea-ab86-90a62cee3ee8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:04.860249 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11ac8c24-18a8-4fea-ab86-90a62cee3ee8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:04.861481 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11ac8c24-18a8-4fea-ab86-90a62cee3ee8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:04.861985 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11ac8c24-18a8-4fea-ab86-90a62cee3ee8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:04.928656 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-11ac8c24-18a8-4fea-ab86-90a62cee3ee8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:04.936628 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-11ac8c24-18a8-4fea-ab86-90a62cee3ee8 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.087858 Dec 15 14:24:04.937223 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 951/1982] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:04 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:05.285649 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-babeb9f3-6de7-4a93-824c-9c7990b3e2a2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:05.286314 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-babeb9f3-6de7-4a93-824c-9c7990b3e2a2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:05.293365 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-babeb9f3-6de7-4a93-824c-9c7990b3e2a2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:05.293850 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-babeb9f3-6de7-4a93-824c-9c7990b3e2a2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:05.294642 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-babeb9f3-6de7-4a93-824c-9c7990b3e2a2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:05.295081 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-babeb9f3-6de7-4a93-824c-9c7990b3e2a2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:05.435858 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-babeb9f3-6de7-4a93-824c-9c7990b3e2a2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:05.444405 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-babeb9f3-6de7-4a93-824c-9c7990b3e2a2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.162735 Dec 15 14:24:05.444932 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1032/1983] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:05 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:05.955028 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-17462f16-1d19-41bd-805a-e17fe904e45a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:05.956110 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-17462f16-1d19-41bd-805a-e17fe904e45a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:05.963815 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17462f16-1d19-41bd-805a-e17fe904e45a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:05.964473 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17462f16-1d19-41bd-805a-e17fe904e45a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:05.965432 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17462f16-1d19-41bd-805a-e17fe904e45a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:05.965950 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17462f16-1d19-41bd-805a-e17fe904e45a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:06.036017 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-17462f16-1d19-41bd-805a-e17fe904e45a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:06.044771 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-17462f16-1d19-41bd-805a-e17fe904e45a tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.093926 Dec 15 14:24:06.045348 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 952/1984] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:05 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:06.462626 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9bbd885b-fe2a-41f5-81e6-ff0230d87434 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:06.463269 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9bbd885b-fe2a-41f5-81e6-ff0230d87434 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:06.470299 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9bbd885b-fe2a-41f5-81e6-ff0230d87434 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:06.470651 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9bbd885b-fe2a-41f5-81e6-ff0230d87434 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:06.471472 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9bbd885b-fe2a-41f5-81e6-ff0230d87434 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:06.471913 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9bbd885b-fe2a-41f5-81e6-ff0230d87434 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:06.627689 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9bbd885b-fe2a-41f5-81e6-ff0230d87434 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:06.636415 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9bbd885b-fe2a-41f5-81e6-ff0230d87434 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.177596 Dec 15 14:24:06.637073 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1033/1985] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:06 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:07.067269 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-14369bc2-66da-4ac2-9706-8c0416ad3efb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:07.067861 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-14369bc2-66da-4ac2-9706-8c0416ad3efb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:07.075855 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-14369bc2-66da-4ac2-9706-8c0416ad3efb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:07.076305 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-14369bc2-66da-4ac2-9706-8c0416ad3efb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:07.077196 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-14369bc2-66da-4ac2-9706-8c0416ad3efb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:07.077637 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-14369bc2-66da-4ac2-9706-8c0416ad3efb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:07.143021 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-14369bc2-66da-4ac2-9706-8c0416ad3efb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:07.151588 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-14369bc2-66da-4ac2-9706-8c0416ad3efb tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.088398 Dec 15 14:24:07.152200 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 953/1986] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:07 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:07.654293 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-951f5d77-605b-496e-98cd-e12e2bfa867e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:07.655008 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-951f5d77-605b-496e-98cd-e12e2bfa867e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:07.662731 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-951f5d77-605b-496e-98cd-e12e2bfa867e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:07.663163 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-951f5d77-605b-496e-98cd-e12e2bfa867e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:07.664011 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-951f5d77-605b-496e-98cd-e12e2bfa867e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:07.664444 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-951f5d77-605b-496e-98cd-e12e2bfa867e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:07.819683 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-951f5d77-605b-496e-98cd-e12e2bfa867e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:07.828803 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-951f5d77-605b-496e-98cd-e12e2bfa867e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.178220 Dec 15 14:24:07.829374 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1034/1987] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:07 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:08.174023 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3b1bfe40-f67d-4772-97e9-18c2ea8bb5e4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:08.174970 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3b1bfe40-f67d-4772-97e9-18c2ea8bb5e4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:08.182688 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b1bfe40-f67d-4772-97e9-18c2ea8bb5e4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:08.183133 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b1bfe40-f67d-4772-97e9-18c2ea8bb5e4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:08.183907 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b1bfe40-f67d-4772-97e9-18c2ea8bb5e4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:08.184335 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b1bfe40-f67d-4772-97e9-18c2ea8bb5e4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:08.252449 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3b1bfe40-f67d-4772-97e9-18c2ea8bb5e4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:08.260641 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3b1bfe40-f67d-4772-97e9-18c2ea8bb5e4 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.093881 Dec 15 14:24:08.261237 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 954/1988] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:08 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:08.847328 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cb0480fe-9375-4ce1-8f80-08eecb1309f9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:08.848076 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cb0480fe-9375-4ce1-8f80-08eecb1309f9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:08.855258 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cb0480fe-9375-4ce1-8f80-08eecb1309f9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:08.855699 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cb0480fe-9375-4ce1-8f80-08eecb1309f9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:08.856481 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cb0480fe-9375-4ce1-8f80-08eecb1309f9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:08.856907 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cb0480fe-9375-4ce1-8f80-08eecb1309f9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:08.997725 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cb0480fe-9375-4ce1-8f80-08eecb1309f9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:09.005745 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cb0480fe-9375-4ce1-8f80-08eecb1309f9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.162238 Dec 15 14:24:09.006481 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1035/1989] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:08 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:09.277584 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d332e6df-f1b4-4793-85c1-d1187979c37c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:09.278267 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d332e6df-f1b4-4793-85c1-d1187979c37c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:09.285207 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d332e6df-f1b4-4793-85c1-d1187979c37c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:09.285644 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d332e6df-f1b4-4793-85c1-d1187979c37c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:09.286488 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d332e6df-f1b4-4793-85c1-d1187979c37c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:09.286904 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d332e6df-f1b4-4793-85c1-d1187979c37c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:09.350381 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d332e6df-f1b4-4793-85c1-d1187979c37c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:09.358827 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d332e6df-f1b4-4793-85c1-d1187979c37c tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.085079 Dec 15 14:24:09.359397 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 955/1990] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:09 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:10.023848 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0e152722-f13e-488d-9b3c-a7f4fd0e2d84 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:10.024519 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0e152722-f13e-488d-9b3c-a7f4fd0e2d84 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:10.031358 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e152722-f13e-488d-9b3c-a7f4fd0e2d84 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:10.031811 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e152722-f13e-488d-9b3c-a7f4fd0e2d84 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:10.032608 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e152722-f13e-488d-9b3c-a7f4fd0e2d84 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:10.033343 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e152722-f13e-488d-9b3c-a7f4fd0e2d84 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:10.174074 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0e152722-f13e-488d-9b3c-a7f4fd0e2d84 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:10.182499 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0e152722-f13e-488d-9b3c-a7f4fd0e2d84 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.162551 Dec 15 14:24:10.183101 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1036/1991] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:10 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:10.376648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ad003d39-b496-40df-b2c9-35dfdaf93697 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:10.377480 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ad003d39-b496-40df-b2c9-35dfdaf93697 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:10.384367 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad003d39-b496-40df-b2c9-35dfdaf93697 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:10.384814 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad003d39-b496-40df-b2c9-35dfdaf93697 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:10.385632 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad003d39-b496-40df-b2c9-35dfdaf93697 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:10.386081 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad003d39-b496-40df-b2c9-35dfdaf93697 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:10.453572 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ad003d39-b496-40df-b2c9-35dfdaf93697 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:10.462168 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ad003d39-b496-40df-b2c9-35dfdaf93697 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.089519 Dec 15 14:24:10.462746 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 956/1992] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:10 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:11.201020 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5a982aa3-3189-4ef5-9ed1-df22654f1389 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:11.201687 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5a982aa3-3189-4ef5-9ed1-df22654f1389 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:11.208494 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a982aa3-3189-4ef5-9ed1-df22654f1389 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:11.209057 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a982aa3-3189-4ef5-9ed1-df22654f1389 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:11.209788 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a982aa3-3189-4ef5-9ed1-df22654f1389 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:11.210224 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a982aa3-3189-4ef5-9ed1-df22654f1389 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:11.351049 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5a982aa3-3189-4ef5-9ed1-df22654f1389 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:11.359294 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5a982aa3-3189-4ef5-9ed1-df22654f1389 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.162339 Dec 15 14:24:11.359832 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1037/1993] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:11 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:11.479549 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3223bd40-7cd6-43fb-b5e6-500d214f379e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:11.480123 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3223bd40-7cd6-43fb-b5e6-500d214f379e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:11.488125 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3223bd40-7cd6-43fb-b5e6-500d214f379e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:11.488585 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3223bd40-7cd6-43fb-b5e6-500d214f379e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:11.489395 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3223bd40-7cd6-43fb-b5e6-500d214f379e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:11.489891 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3223bd40-7cd6-43fb-b5e6-500d214f379e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:11.558949 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3223bd40-7cd6-43fb-b5e6-500d214f379e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:11.567100 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3223bd40-7cd6-43fb-b5e6-500d214f379e tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.091447 Dec 15 14:24:11.567734 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 957/1994] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:11 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:12.377077 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-236f9ecb-1e2a-480e-af10-740fcfff5d8c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:12.377732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-236f9ecb-1e2a-480e-af10-740fcfff5d8c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:12.384670 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-236f9ecb-1e2a-480e-af10-740fcfff5d8c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:12.385116 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-236f9ecb-1e2a-480e-af10-740fcfff5d8c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:12.385924 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-236f9ecb-1e2a-480e-af10-740fcfff5d8c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:12.386357 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-236f9ecb-1e2a-480e-af10-740fcfff5d8c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:12.531051 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-236f9ecb-1e2a-480e-af10-740fcfff5d8c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:12.539932 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-236f9ecb-1e2a-480e-af10-740fcfff5d8c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.166717 Dec 15 14:24:12.540524 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1038/1995] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:12 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:12.585738 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-56f62c81-c71e-4c3a-a21e-11690b77a8e6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:12.586571 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-56f62c81-c71e-4c3a-a21e-11690b77a8e6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:12.593341 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56f62c81-c71e-4c3a-a21e-11690b77a8e6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:12.593824 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56f62c81-c71e-4c3a-a21e-11690b77a8e6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:12.594600 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56f62c81-c71e-4c3a-a21e-11690b77a8e6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:12.595035 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56f62c81-c71e-4c3a-a21e-11690b77a8e6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:12.657224 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-56f62c81-c71e-4c3a-a21e-11690b77a8e6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:12.666447 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-56f62c81-c71e-4c3a-a21e-11690b77a8e6 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.084684 Dec 15 14:24:12.667510 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 958/1996] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:12 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:13.558235 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-71b31560-7178-40c2-8008-f82bf35fd246 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:13.558833 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-71b31560-7178-40c2-8008-f82bf35fd246 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:13.565732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71b31560-7178-40c2-8008-f82bf35fd246 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:13.566183 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71b31560-7178-40c2-8008-f82bf35fd246 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:13.566987 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71b31560-7178-40c2-8008-f82bf35fd246 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:13.567400 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71b31560-7178-40c2-8008-f82bf35fd246 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:13.692161 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a3e35e5f-4610-4f8c-9576-b0105aef0061 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:13.692811 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a3e35e5f-4610-4f8c-9576-b0105aef0061 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:13.700066 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3e35e5f-4610-4f8c-9576-b0105aef0061 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:13.700629 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3e35e5f-4610-4f8c-9576-b0105aef0061 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:13.701439 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3e35e5f-4610-4f8c-9576-b0105aef0061 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:13.701909 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3e35e5f-4610-4f8c-9576-b0105aef0061 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:13.707615 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-71b31560-7178-40c2-8008-f82bf35fd246 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:13.715802 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-71b31560-7178-40c2-8008-f82bf35fd246 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.161410 Dec 15 14:24:13.716422 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1039/1997] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:13 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:13.765973 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a3e35e5f-4610-4f8c-9576-b0105aef0061 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:13.774087 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a3e35e5f-4610-4f8c-9576-b0105aef0061 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.086455 Dec 15 14:24:13.774645 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 959/1998] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:13 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:24:14.734229 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-428b9cdf-6b51-4afc-9598-76afcd616350 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:14.734874 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-428b9cdf-6b51-4afc-9598-76afcd616350 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:14.742194 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-428b9cdf-6b51-4afc-9598-76afcd616350 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:14.742646 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-428b9cdf-6b51-4afc-9598-76afcd616350 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:14.743459 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-428b9cdf-6b51-4afc-9598-76afcd616350 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:14.743886 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-428b9cdf-6b51-4afc-9598-76afcd616350 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:14.793355 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f28b7c5f-ff44-4c6d-8386-9b651965221d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:14.794528 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f28b7c5f-ff44-4c6d-8386-9b651965221d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:14.803053 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f28b7c5f-ff44-4c6d-8386-9b651965221d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:14.803504 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f28b7c5f-ff44-4c6d-8386-9b651965221d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:14.804381 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f28b7c5f-ff44-4c6d-8386-9b651965221d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:14.804894 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f28b7c5f-ff44-4c6d-8386-9b651965221d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:14.882673 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f28b7c5f-ff44-4c6d-8386-9b651965221d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:14.890984 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f28b7c5f-ff44-4c6d-8386-9b651965221d tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.103488 Dec 15 14:24:14.891691 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 960/1999] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:14 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:14.927584 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-428b9cdf-6b51-4afc-9598-76afcd616350 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:14.936695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-428b9cdf-6b51-4afc-9598-76afcd616350 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.206174 Dec 15 14:24:14.937299 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1040/2000] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:14 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:15.914854 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fdaa8f69-7542-4264-ad47-71a7a91ede43 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:15.916033 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fdaa8f69-7542-4264-ad47-71a7a91ede43 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:15.925250 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fdaa8f69-7542-4264-ad47-71a7a91ede43 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:15.925764 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fdaa8f69-7542-4264-ad47-71a7a91ede43 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:15.926624 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fdaa8f69-7542-4264-ad47-71a7a91ede43 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:15.927060 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fdaa8f69-7542-4264-ad47-71a7a91ede43 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:15.962851 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f5c690e4-b0fe-49d8-ba0f-4d4c2688af5e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:15.962851 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f5c690e4-b0fe-49d8-ba0f-4d4c2688af5e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:15.973293 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5c690e4-b0fe-49d8-ba0f-4d4c2688af5e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:15.974178 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5c690e4-b0fe-49d8-ba0f-4d4c2688af5e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:15.976067 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5c690e4-b0fe-49d8-ba0f-4d4c2688af5e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:15.976067 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5c690e4-b0fe-49d8-ba0f-4d4c2688af5e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:16.008173 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fdaa8f69-7542-4264-ad47-71a7a91ede43 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:16.021376 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fdaa8f69-7542-4264-ad47-71a7a91ede43 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.111318 Dec 15 14:24:16.022465 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 961/2001] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:15 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:16.151447 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f5c690e4-b0fe-49d8-ba0f-4d4c2688af5e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:16.161716 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f5c690e4-b0fe-49d8-ba0f-4d4c2688af5e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.204782 Dec 15 14:24:16.162297 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1041/2002] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:15 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:24:17.043967 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1a7a1065-5fb0-4fd3-97fa-7cf521978789 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:17.044577 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1a7a1065-5fb0-4fd3-97fa-7cf521978789 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] [instance: 12be41af-387a-4090-93dd-d26d8e97bf45] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:17.051952 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a7a1065-5fb0-4fd3-97fa-7cf521978789 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:17.052473 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a7a1065-5fb0-4fd3-97fa-7cf521978789 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:17.053442 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a7a1065-5fb0-4fd3-97fa-7cf521978789 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:17.053847 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a7a1065-5fb0-4fd3-97fa-7cf521978789 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:17.127587 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1a7a1065-5fb0-4fd3-97fa-7cf521978789 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce494e335af643b18361d73fa6a13a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91c6aedd2b540029697c563f45674ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:17.135566 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1a7a1065-5fb0-4fd3-97fa-7cf521978789 tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45" status: 200 len: 1213 microversion: 2.1 time: 0.095585 Dec 15 14:24:17.136141 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 962/2003] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:17 2021] GET /compute/v2.1/servers/12be41af-387a-4090-93dd-d26d8e97bf45 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:24:17.186571 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-946ff576-a73e-4333-b3bd-0a73c3aa58f4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:17.187239 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-946ff576-a73e-4333-b3bd-0a73c3aa58f4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:17.197334 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-946ff576-a73e-4333-b3bd-0a73c3aa58f4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:17.197824 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-946ff576-a73e-4333-b3bd-0a73c3aa58f4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:17.198984 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-946ff576-a73e-4333-b3bd-0a73c3aa58f4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:17.199516 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-946ff576-a73e-4333-b3bd-0a73c3aa58f4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:17.341538 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e71b2177-cf6f-4e24-8acb-76db6d3c769b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] Calling method '.version_select at 0x7faa3c935820>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:17.375297 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e71b2177-cf6f-4e24-8acb-76db6d3c769b tempest-TestShelveInstance-572907427 tempest-TestShelveInstance-572907427-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1666222908" status: 202 len: 0 microversion: 2.1 time: 0.039283 Dec 15 14:24:17.376082 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-946ff576-a73e-4333-b3bd-0a73c3aa58f4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:17.386301 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 963/2004] 10.222.0.42 () {58 vars in 1253 bytes} [Wed Dec 15 14:24:17 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1666222908 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:24:17.389203 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-946ff576-a73e-4333-b3bd-0a73c3aa58f4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.206687 Dec 15 14:24:17.390934 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1042/2005] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:17 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:18.423456 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-eef75544-60e0-41c2-863d-0fc924053deb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:18.424110 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-eef75544-60e0-41c2-863d-0fc924053deb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:18.431229 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eef75544-60e0-41c2-863d-0fc924053deb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:18.431675 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eef75544-60e0-41c2-863d-0fc924053deb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:18.432484 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eef75544-60e0-41c2-863d-0fc924053deb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:18.432917 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eef75544-60e0-41c2-863d-0fc924053deb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:18.703836 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-eef75544-60e0-41c2-863d-0fc924053deb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:18.718711 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-eef75544-60e0-41c2-863d-0fc924053deb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.301502 Dec 15 14:24:18.719582 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 964/2006] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:18 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:19.740391 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0a467635-1ac9-4a04-81ad-63fc6dcc9fdf tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:19.741251 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0a467635-1ac9-4a04-81ad-63fc6dcc9fdf tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:19.750631 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0a467635-1ac9-4a04-81ad-63fc6dcc9fdf tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:19.751240 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0a467635-1ac9-4a04-81ad-63fc6dcc9fdf tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:19.753343 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0a467635-1ac9-4a04-81ad-63fc6dcc9fdf tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:19.754274 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0a467635-1ac9-4a04-81ad-63fc6dcc9fdf tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:19.927622 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0a467635-1ac9-4a04-81ad-63fc6dcc9fdf tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:19.937121 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0a467635-1ac9-4a04-81ad-63fc6dcc9fdf tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.202774 Dec 15 14:24:19.948116 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1043/2007] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:19 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:20.960696 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-757ca42f-80e9-4026-9de9-cd69008220c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:20.961762 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-757ca42f-80e9-4026-9de9-cd69008220c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:20.972965 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-757ca42f-80e9-4026-9de9-cd69008220c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:20.973415 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-757ca42f-80e9-4026-9de9-cd69008220c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:20.974478 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-757ca42f-80e9-4026-9de9-cd69008220c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:20.974917 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-757ca42f-80e9-4026-9de9-cd69008220c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:21.142054 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-757ca42f-80e9-4026-9de9-cd69008220c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:21.150838 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-757ca42f-80e9-4026-9de9-cd69008220c8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.197267 Dec 15 14:24:21.151435 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 965/2008] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:20 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:22.168582 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b007cae9-1858-4d47-8d24-14f20fa58fce tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:22.169221 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b007cae9-1858-4d47-8d24-14f20fa58fce tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:22.178407 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b007cae9-1858-4d47-8d24-14f20fa58fce tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:22.178894 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b007cae9-1858-4d47-8d24-14f20fa58fce tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:22.179716 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b007cae9-1858-4d47-8d24-14f20fa58fce tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:22.180152 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b007cae9-1858-4d47-8d24-14f20fa58fce tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:22.407680 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b007cae9-1858-4d47-8d24-14f20fa58fce tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:22.416490 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b007cae9-1858-4d47-8d24-14f20fa58fce tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.251563 Dec 15 14:24:22.417220 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1044/2009] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:22 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:23.437335 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cf017249-17ce-4de5-8f57-d09f3f93bb7b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:23.438491 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cf017249-17ce-4de5-8f57-d09f3f93bb7b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:23.448639 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cf017249-17ce-4de5-8f57-d09f3f93bb7b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:23.449405 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cf017249-17ce-4de5-8f57-d09f3f93bb7b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:23.450393 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cf017249-17ce-4de5-8f57-d09f3f93bb7b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:23.451341 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cf017249-17ce-4de5-8f57-d09f3f93bb7b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:23.630057 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cf017249-17ce-4de5-8f57-d09f3f93bb7b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:23.640390 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cf017249-17ce-4de5-8f57-d09f3f93bb7b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.208327 Dec 15 14:24:23.641145 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 966/2010] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:23 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:24:24.660097 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c4b9c557-e0a6-41b9-9df9-3e07360843f6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:24.660670 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c4b9c557-e0a6-41b9-9df9-3e07360843f6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:24.668746 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4b9c557-e0a6-41b9-9df9-3e07360843f6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:24.671129 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4b9c557-e0a6-41b9-9df9-3e07360843f6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:24.672393 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4b9c557-e0a6-41b9-9df9-3e07360843f6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:24.672980 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4b9c557-e0a6-41b9-9df9-3e07360843f6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:24.863125 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c4b9c557-e0a6-41b9-9df9-3e07360843f6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:24.875560 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c4b9c557-e0a6-41b9-9df9-3e07360843f6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.219392 Dec 15 14:24:24.890095 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1045/2011] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:24 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:25.894932 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-57935337-d7fd-4f23-8961-c15b6fe919a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:25.895522 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-57935337-d7fd-4f23-8961-c15b6fe919a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:25.902367 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57935337-d7fd-4f23-8961-c15b6fe919a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:25.902822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57935337-d7fd-4f23-8961-c15b6fe919a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:25.903623 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57935337-d7fd-4f23-8961-c15b6fe919a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:25.904044 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57935337-d7fd-4f23-8961-c15b6fe919a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:26.055204 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-57935337-d7fd-4f23-8961-c15b6fe919a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:26.064882 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-57935337-d7fd-4f23-8961-c15b6fe919a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.173810 Dec 15 14:24:26.065546 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 967/2012] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:25 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:27.083244 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-15448766-a2af-4190-aaba-982ebca23448 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:27.083864 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-15448766-a2af-4190-aaba-982ebca23448 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:27.090666 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15448766-a2af-4190-aaba-982ebca23448 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:27.091112 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15448766-a2af-4190-aaba-982ebca23448 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:27.091885 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15448766-a2af-4190-aaba-982ebca23448 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:27.092319 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15448766-a2af-4190-aaba-982ebca23448 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:27.249410 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-15448766-a2af-4190-aaba-982ebca23448 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:27.258241 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-15448766-a2af-4190-aaba-982ebca23448 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.179066 Dec 15 14:24:27.258797 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1046/2013] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:27 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:28.276478 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-005572de-787c-4224-96f5-5f35095a72e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:28.277099 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-005572de-787c-4224-96f5-5f35095a72e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:28.284356 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-005572de-787c-4224-96f5-5f35095a72e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:28.284820 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-005572de-787c-4224-96f5-5f35095a72e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:28.285646 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-005572de-787c-4224-96f5-5f35095a72e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:28.286229 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-005572de-787c-4224-96f5-5f35095a72e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:28.518766 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-005572de-787c-4224-96f5-5f35095a72e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:28.527049 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-005572de-787c-4224-96f5-5f35095a72e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1559 microversion: 2.1 time: 0.254414 Dec 15 14:24:28.527647 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 968/2014] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:28 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1559 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:28.608965 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-0793fdab-8fc2-418d-8a66-8bee44d419d7 req-8a844537-2f2d-4e96-9886-640cacad4912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95358386-841b-4e1b-9d6b-8fdc3751799f", "name": "network-vif-deleted", "tag": "83ecfae9-7ad0-4a5f-a870-5c76e803e8d1"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:24:28.610939 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:24:28.610939 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:24:28.619542 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-0793fdab-8fc2-418d-8a66-8bee44d419d7 req-8a844537-2f2d-4e96-9886-640cacad4912 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:28.619980 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-0793fdab-8fc2-418d-8a66-8bee44d419d7 req-8a844537-2f2d-4e96-9886-640cacad4912 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:28.633089 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-0793fdab-8fc2-418d-8a66-8bee44d419d7 req-8a844537-2f2d-4e96-9886-640cacad4912 service nova] Creating event network-vif-deleted:83ecfae9-7ad0-4a5f-a870-5c76e803e8d1 for instance 95358386-841b-4e1b-9d6b-8fdc3751799f on hv-cinder-82182 Dec 15 14:24:28.637002 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: ERROR oslo.messaging._drivers.impl_rabbit [req-0793fdab-8fc2-418d-8a66-8bee44d419d7 req-8a844537-2f2d-4e96-9886-640cacad4912 service nova] [a2b14dff-eb4a-4e0e-8c5e-33f3e4e9e959] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 14:24:29.548959 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fd5c60d3-de9f-4957-a9c4-d0d0f60ad752 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:29.550033 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fd5c60d3-de9f-4957-a9c4-d0d0f60ad752 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:29.560511 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd5c60d3-de9f-4957-a9c4-d0d0f60ad752 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:29.561251 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd5c60d3-de9f-4957-a9c4-d0d0f60ad752 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:29.562583 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd5c60d3-de9f-4957-a9c4-d0d0f60ad752 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:29.563305 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd5c60d3-de9f-4957-a9c4-d0d0f60ad752 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:29.628246 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fd5c60d3-de9f-4957-a9c4-d0d0f60ad752 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:29.636544 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fd5c60d3-de9f-4957-a9c4-d0d0f60ad752 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.094687 Dec 15 14:24:29.637097 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 969/2015] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:29 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:29.654003 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [req-0793fdab-8fc2-418d-8a66-8bee44d419d7 req-8a844537-2f2d-4e96-9886-640cacad4912 service nova] [a2b14dff-eb4a-4e0e-8c5e-33f3e4e9e959] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 52502. Dec 15 14:24:29.658333 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-0793fdab-8fc2-418d-8a66-8bee44d419d7 req-8a844537-2f2d-4e96-9886-640cacad4912 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.053478 Dec 15 14:24:29.659037 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1047/2016] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:24:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:24:30.654979 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-28fe4515-094f-40b1-91ed-29ba50e5e518 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:30.655584 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-28fe4515-094f-40b1-91ed-29ba50e5e518 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:30.663105 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28fe4515-094f-40b1-91ed-29ba50e5e518 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:30.663615 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28fe4515-094f-40b1-91ed-29ba50e5e518 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:30.664413 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28fe4515-094f-40b1-91ed-29ba50e5e518 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:30.664848 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28fe4515-094f-40b1-91ed-29ba50e5e518 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:30.733442 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-28fe4515-094f-40b1-91ed-29ba50e5e518 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:30.742184 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-28fe4515-094f-40b1-91ed-29ba50e5e518 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.092372 Dec 15 14:24:30.742836 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 970/2017] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:30 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:31.762298 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-66dbc9fd-558a-4925-94d5-3450e003bfdc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:31.763016 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-66dbc9fd-558a-4925-94d5-3450e003bfdc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:31.770439 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66dbc9fd-558a-4925-94d5-3450e003bfdc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:31.770907 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66dbc9fd-558a-4925-94d5-3450e003bfdc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:31.771817 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66dbc9fd-558a-4925-94d5-3450e003bfdc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:31.772259 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66dbc9fd-558a-4925-94d5-3450e003bfdc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:31.837975 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-66dbc9fd-558a-4925-94d5-3450e003bfdc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:31.846891 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-66dbc9fd-558a-4925-94d5-3450e003bfdc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.089140 Dec 15 14:24:31.847484 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1048/2018] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:31 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:32.868948 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a8ff4c60-8f31-4aa5-a8cf-8ab2f8f6b3e1 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:32.870198 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a8ff4c60-8f31-4aa5-a8cf-8ab2f8f6b3e1 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:32.880069 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8ff4c60-8f31-4aa5-a8cf-8ab2f8f6b3e1 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:32.880484 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8ff4c60-8f31-4aa5-a8cf-8ab2f8f6b3e1 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:32.881276 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8ff4c60-8f31-4aa5-a8cf-8ab2f8f6b3e1 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:32.881730 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8ff4c60-8f31-4aa5-a8cf-8ab2f8f6b3e1 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:32.945424 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a8ff4c60-8f31-4aa5-a8cf-8ab2f8f6b3e1 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:32.954734 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a8ff4c60-8f31-4aa5-a8cf-8ab2f8f6b3e1 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.092043 Dec 15 14:24:32.955316 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 971/2019] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:32 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:33.971976 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-43485834-9473-49da-b471-7fb9b803945c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:33.972569 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-43485834-9473-49da-b471-7fb9b803945c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:33.980277 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-43485834-9473-49da-b471-7fb9b803945c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:33.980728 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-43485834-9473-49da-b471-7fb9b803945c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:33.981523 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-43485834-9473-49da-b471-7fb9b803945c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:33.982107 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-43485834-9473-49da-b471-7fb9b803945c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:34.047872 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-43485834-9473-49da-b471-7fb9b803945c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:34.056556 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-43485834-9473-49da-b471-7fb9b803945c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.088376 Dec 15 14:24:34.057135 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1049/2020] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:33 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:35.075227 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e0d2d9f9-091a-436c-847c-e57dc55f2be7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:35.075862 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e0d2d9f9-091a-436c-847c-e57dc55f2be7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:35.087283 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e0d2d9f9-091a-436c-847c-e57dc55f2be7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:35.088502 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e0d2d9f9-091a-436c-847c-e57dc55f2be7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:35.089682 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e0d2d9f9-091a-436c-847c-e57dc55f2be7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:35.090354 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e0d2d9f9-091a-436c-847c-e57dc55f2be7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:35.156050 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e0d2d9f9-091a-436c-847c-e57dc55f2be7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:35.168337 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e0d2d9f9-091a-436c-847c-e57dc55f2be7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.097263 Dec 15 14:24:35.168933 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 972/2021] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:35 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:36.186751 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2fc0ebeb-e296-4e53-a876-1a0235e5b3ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:36.188738 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2fc0ebeb-e296-4e53-a876-1a0235e5b3ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:36.195334 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2fc0ebeb-e296-4e53-a876-1a0235e5b3ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:36.195776 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2fc0ebeb-e296-4e53-a876-1a0235e5b3ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:36.196905 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2fc0ebeb-e296-4e53-a876-1a0235e5b3ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:36.197335 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2fc0ebeb-e296-4e53-a876-1a0235e5b3ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:36.268745 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2fc0ebeb-e296-4e53-a876-1a0235e5b3ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:36.278075 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2fc0ebeb-e296-4e53-a876-1a0235e5b3ef tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.095262 Dec 15 14:24:36.278799 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1050/2022] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:36 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:37.297791 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fe82c4c7-16f6-4e51-b33e-abe8263bf588 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:37.298663 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fe82c4c7-16f6-4e51-b33e-abe8263bf588 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:37.306683 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe82c4c7-16f6-4e51-b33e-abe8263bf588 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:37.307135 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe82c4c7-16f6-4e51-b33e-abe8263bf588 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:37.307944 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe82c4c7-16f6-4e51-b33e-abe8263bf588 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:37.308381 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe82c4c7-16f6-4e51-b33e-abe8263bf588 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:37.381132 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fe82c4c7-16f6-4e51-b33e-abe8263bf588 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:37.391060 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fe82c4c7-16f6-4e51-b33e-abe8263bf588 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.097254 Dec 15 14:24:37.391674 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 973/2023] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:37 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:38.412003 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-45ec606a-7ee0-4de5-8609-86d3198a4257 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:38.412615 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-45ec606a-7ee0-4de5-8609-86d3198a4257 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:38.419234 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45ec606a-7ee0-4de5-8609-86d3198a4257 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:38.419695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45ec606a-7ee0-4de5-8609-86d3198a4257 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:38.421479 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45ec606a-7ee0-4de5-8609-86d3198a4257 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:38.421841 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45ec606a-7ee0-4de5-8609-86d3198a4257 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:38.498673 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-45ec606a-7ee0-4de5-8609-86d3198a4257 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:38.509019 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-45ec606a-7ee0-4de5-8609-86d3198a4257 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.101560 Dec 15 14:24:38.509636 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1051/2024] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:38 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:39.527796 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6f0a6ee7-4ec0-478a-a9a3-e1953f4c43ab tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:39.528415 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6f0a6ee7-4ec0-478a-a9a3-e1953f4c43ab tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:39.535101 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f0a6ee7-4ec0-478a-a9a3-e1953f4c43ab tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:39.535558 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f0a6ee7-4ec0-478a-a9a3-e1953f4c43ab tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:39.536352 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f0a6ee7-4ec0-478a-a9a3-e1953f4c43ab tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:39.536986 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f0a6ee7-4ec0-478a-a9a3-e1953f4c43ab tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:39.609158 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6f0a6ee7-4ec0-478a-a9a3-e1953f4c43ab tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:39.620452 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6f0a6ee7-4ec0-478a-a9a3-e1953f4c43ab tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.096110 Dec 15 14:24:39.621251 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 974/2025] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:39 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:40.646464 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-431342c8-1f84-4731-9069-1271e1926871 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:40.647429 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-431342c8-1f84-4731-9069-1271e1926871 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:40.660431 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-431342c8-1f84-4731-9069-1271e1926871 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:40.660952 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-431342c8-1f84-4731-9069-1271e1926871 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:40.662073 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-431342c8-1f84-4731-9069-1271e1926871 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:40.662545 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-431342c8-1f84-4731-9069-1271e1926871 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:40.731652 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-431342c8-1f84-4731-9069-1271e1926871 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:40.740711 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-431342c8-1f84-4731-9069-1271e1926871 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.098144 Dec 15 14:24:40.741285 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1052/2026] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:40 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:41.759150 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6b2207fd-db62-402e-87e7-1dce605fb0f5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:41.759723 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6b2207fd-db62-402e-87e7-1dce605fb0f5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:41.767132 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b2207fd-db62-402e-87e7-1dce605fb0f5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:41.767581 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b2207fd-db62-402e-87e7-1dce605fb0f5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:41.768394 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b2207fd-db62-402e-87e7-1dce605fb0f5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:41.768913 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b2207fd-db62-402e-87e7-1dce605fb0f5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:41.835034 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6b2207fd-db62-402e-87e7-1dce605fb0f5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:41.843671 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6b2207fd-db62-402e-87e7-1dce605fb0f5 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.088410 Dec 15 14:24:41.844252 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 975/2027] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:41 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:42.862322 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-96553e16-232d-4389-9cfc-bcce317746e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:42.862925 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-96553e16-232d-4389-9cfc-bcce317746e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:42.869904 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96553e16-232d-4389-9cfc-bcce317746e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:42.870351 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96553e16-232d-4389-9cfc-bcce317746e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:42.871137 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96553e16-232d-4389-9cfc-bcce317746e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:42.871569 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96553e16-232d-4389-9cfc-bcce317746e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:42.947399 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-96553e16-232d-4389-9cfc-bcce317746e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:42.955621 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-96553e16-232d-4389-9cfc-bcce317746e7 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.097295 Dec 15 14:24:42.956221 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1053/2028] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:42 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:43.973778 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-69302295-e97b-4373-835f-b509603020c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:43.974419 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-69302295-e97b-4373-835f-b509603020c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:43.981545 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69302295-e97b-4373-835f-b509603020c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:43.982037 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69302295-e97b-4373-835f-b509603020c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:43.982835 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69302295-e97b-4373-835f-b509603020c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:43.983277 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69302295-e97b-4373-835f-b509603020c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:44.046983 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-69302295-e97b-4373-835f-b509603020c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:44.055574 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-69302295-e97b-4373-835f-b509603020c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.085988 Dec 15 14:24:44.056187 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 976/2029] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:43 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:45.074143 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-71d2aac6-4767-4a3a-926c-a99e58768d25 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:45.074723 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-71d2aac6-4767-4a3a-926c-a99e58768d25 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:45.081543 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71d2aac6-4767-4a3a-926c-a99e58768d25 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:45.082008 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71d2aac6-4767-4a3a-926c-a99e58768d25 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:45.082770 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71d2aac6-4767-4a3a-926c-a99e58768d25 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:45.083201 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71d2aac6-4767-4a3a-926c-a99e58768d25 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:45.305593 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-71d2aac6-4767-4a3a-926c-a99e58768d25 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:45.313705 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-71d2aac6-4767-4a3a-926c-a99e58768d25 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.244000 Dec 15 14:24:45.314265 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1054/2030] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:45 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:46.331535 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d15a9212-ebfa-4431-936a-4ee0360d7cd3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:46.332154 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d15a9212-ebfa-4431-936a-4ee0360d7cd3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:46.339309 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d15a9212-ebfa-4431-936a-4ee0360d7cd3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:46.339763 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d15a9212-ebfa-4431-936a-4ee0360d7cd3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:46.340559 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d15a9212-ebfa-4431-936a-4ee0360d7cd3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:46.340997 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d15a9212-ebfa-4431-936a-4ee0360d7cd3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:46.406250 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d15a9212-ebfa-4431-936a-4ee0360d7cd3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:46.417464 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d15a9212-ebfa-4431-936a-4ee0360d7cd3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.089677 Dec 15 14:24:46.418060 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 977/2031] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:46 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:47.434501 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-abc16aac-da53-4632-abb6-0917f3fdd233 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:47.435108 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-abc16aac-da53-4632-abb6-0917f3fdd233 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:47.442065 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abc16aac-da53-4632-abb6-0917f3fdd233 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:47.442616 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abc16aac-da53-4632-abb6-0917f3fdd233 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:47.443315 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abc16aac-da53-4632-abb6-0917f3fdd233 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:47.443748 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abc16aac-da53-4632-abb6-0917f3fdd233 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:47.511222 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-abc16aac-da53-4632-abb6-0917f3fdd233 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:47.519883 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-abc16aac-da53-4632-abb6-0917f3fdd233 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.089094 Dec 15 14:24:47.520447 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1055/2032] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:47 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:48.540546 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4df498c1-1664-44f3-b907-55bfe9312511 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:48.541533 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4df498c1-1664-44f3-b907-55bfe9312511 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:48.551890 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4df498c1-1664-44f3-b907-55bfe9312511 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:48.552452 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4df498c1-1664-44f3-b907-55bfe9312511 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:48.553682 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4df498c1-1664-44f3-b907-55bfe9312511 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:48.554336 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4df498c1-1664-44f3-b907-55bfe9312511 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:48.625743 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4df498c1-1664-44f3-b907-55bfe9312511 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:48.634248 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4df498c1-1664-44f3-b907-55bfe9312511 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.099197 Dec 15 14:24:48.634898 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 978/2033] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:48 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:49.661329 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-24825d6f-0222-40f1-bbb8-43770b4f4bfb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:49.662456 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-24825d6f-0222-40f1-bbb8-43770b4f4bfb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:49.674084 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24825d6f-0222-40f1-bbb8-43770b4f4bfb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:49.674871 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24825d6f-0222-40f1-bbb8-43770b4f4bfb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:49.676333 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24825d6f-0222-40f1-bbb8-43770b4f4bfb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:49.677162 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24825d6f-0222-40f1-bbb8-43770b4f4bfb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:49.751885 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-24825d6f-0222-40f1-bbb8-43770b4f4bfb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:49.760496 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-24825d6f-0222-40f1-bbb8-43770b4f4bfb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.109468 Dec 15 14:24:49.761299 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1056/2034] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:49 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:50.779542 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-02ffe389-2c83-4d5f-8f69-d3ed74b8a91c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:50.779951 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-02ffe389-2c83-4d5f-8f69-d3ed74b8a91c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:50.786262 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-02ffe389-2c83-4d5f-8f69-d3ed74b8a91c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:50.786708 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-02ffe389-2c83-4d5f-8f69-d3ed74b8a91c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:50.787493 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-02ffe389-2c83-4d5f-8f69-d3ed74b8a91c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:50.787922 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-02ffe389-2c83-4d5f-8f69-d3ed74b8a91c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:50.851688 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-02ffe389-2c83-4d5f-8f69-d3ed74b8a91c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:50.861496 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-02ffe389-2c83-4d5f-8f69-d3ed74b8a91c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.086128 Dec 15 14:24:50.862207 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 979/2035] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:50 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:51.879459 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ce4f2143-50c6-456f-bb67-4f9cdac23bcd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:51.880084 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ce4f2143-50c6-456f-bb67-4f9cdac23bcd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:51.887249 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce4f2143-50c6-456f-bb67-4f9cdac23bcd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:51.887764 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce4f2143-50c6-456f-bb67-4f9cdac23bcd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:51.888563 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce4f2143-50c6-456f-bb67-4f9cdac23bcd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:51.889061 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce4f2143-50c6-456f-bb67-4f9cdac23bcd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:51.951023 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ce4f2143-50c6-456f-bb67-4f9cdac23bcd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:51.959162 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ce4f2143-50c6-456f-bb67-4f9cdac23bcd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.083437 Dec 15 14:24:51.959692 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1057/2036] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:51 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:52.977288 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7a1c8a05-e7e7-4b09-ad38-758e07423a55 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:52.977967 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7a1c8a05-e7e7-4b09-ad38-758e07423a55 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:52.984315 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a1c8a05-e7e7-4b09-ad38-758e07423a55 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:52.984766 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a1c8a05-e7e7-4b09-ad38-758e07423a55 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:52.985555 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a1c8a05-e7e7-4b09-ad38-758e07423a55 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:52.986023 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a1c8a05-e7e7-4b09-ad38-758e07423a55 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:53.048085 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7a1c8a05-e7e7-4b09-ad38-758e07423a55 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:53.056349 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7a1c8a05-e7e7-4b09-ad38-758e07423a55 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.083305 Dec 15 14:24:53.056889 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 980/2037] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:52 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:54.074434 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f3a88797-14bd-43ee-af4d-c905ddc6fd99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:54.075399 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f3a88797-14bd-43ee-af4d-c905ddc6fd99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:54.085016 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f3a88797-14bd-43ee-af4d-c905ddc6fd99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:54.085795 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f3a88797-14bd-43ee-af4d-c905ddc6fd99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:54.087071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f3a88797-14bd-43ee-af4d-c905ddc6fd99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:54.087711 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f3a88797-14bd-43ee-af4d-c905ddc6fd99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:54.155411 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f3a88797-14bd-43ee-af4d-c905ddc6fd99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:54.164631 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f3a88797-14bd-43ee-af4d-c905ddc6fd99 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.094270 Dec 15 14:24:54.165193 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1058/2038] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:54 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:55.182693 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5dd6c174-ae15-45b6-a043-8a75e12b087e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:55.183342 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5dd6c174-ae15-45b6-a043-8a75e12b087e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:55.190519 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5dd6c174-ae15-45b6-a043-8a75e12b087e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:55.190967 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5dd6c174-ae15-45b6-a043-8a75e12b087e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:55.191760 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5dd6c174-ae15-45b6-a043-8a75e12b087e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:55.192198 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5dd6c174-ae15-45b6-a043-8a75e12b087e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:55.261780 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5dd6c174-ae15-45b6-a043-8a75e12b087e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:55.270678 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5dd6c174-ae15-45b6-a043-8a75e12b087e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.091731 Dec 15 14:24:55.271252 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 981/2039] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:55 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:56.288313 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f93c9e56-4301-47cb-a2ed-6a00fcda1ffd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:56.288953 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f93c9e56-4301-47cb-a2ed-6a00fcda1ffd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:56.296148 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f93c9e56-4301-47cb-a2ed-6a00fcda1ffd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:56.296596 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f93c9e56-4301-47cb-a2ed-6a00fcda1ffd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:56.297397 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f93c9e56-4301-47cb-a2ed-6a00fcda1ffd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:56.297873 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f93c9e56-4301-47cb-a2ed-6a00fcda1ffd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:56.363485 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f93c9e56-4301-47cb-a2ed-6a00fcda1ffd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:56.371928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f93c9e56-4301-47cb-a2ed-6a00fcda1ffd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.087269 Dec 15 14:24:56.372582 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1059/2040] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:56 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:57.389705 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-627892e3-8c74-4452-9707-f8095bcb7ea0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:57.390380 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-627892e3-8c74-4452-9707-f8095bcb7ea0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:57.397096 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-627892e3-8c74-4452-9707-f8095bcb7ea0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:57.397543 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-627892e3-8c74-4452-9707-f8095bcb7ea0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:57.398366 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-627892e3-8c74-4452-9707-f8095bcb7ea0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:57.398803 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-627892e3-8c74-4452-9707-f8095bcb7ea0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:57.462761 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-627892e3-8c74-4452-9707-f8095bcb7ea0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:57.471622 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-627892e3-8c74-4452-9707-f8095bcb7ea0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.085775 Dec 15 14:24:57.472223 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 982/2041] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:57 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:58.490013 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6cd21c54-7618-41ad-b9bb-13dd6e92dd3a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:58.490696 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6cd21c54-7618-41ad-b9bb-13dd6e92dd3a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:58.498015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6cd21c54-7618-41ad-b9bb-13dd6e92dd3a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:58.498469 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6cd21c54-7618-41ad-b9bb-13dd6e92dd3a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:58.499283 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6cd21c54-7618-41ad-b9bb-13dd6e92dd3a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:58.499723 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6cd21c54-7618-41ad-b9bb-13dd6e92dd3a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:58.564744 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6cd21c54-7618-41ad-b9bb-13dd6e92dd3a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:58.573542 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6cd21c54-7618-41ad-b9bb-13dd6e92dd3a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.087486 Dec 15 14:24:58.574149 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1060/2042] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:58 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:59.592183 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2d6c1ac2-5ae3-4061-aeed-7069cf71c540 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:59.592901 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2d6c1ac2-5ae3-4061-aeed-7069cf71c540 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:59.599594 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d6c1ac2-5ae3-4061-aeed-7069cf71c540 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:59.600054 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d6c1ac2-5ae3-4061-aeed-7069cf71c540 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:59.600874 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d6c1ac2-5ae3-4061-aeed-7069cf71c540 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:59.601317 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d6c1ac2-5ae3-4061-aeed-7069cf71c540 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:59.666433 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2d6c1ac2-5ae3-4061-aeed-7069cf71c540 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:59.675173 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2d6c1ac2-5ae3-4061-aeed-7069cf71c540 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.087026 Dec 15 14:24:59.675737 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 983/2043] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:59 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:00.701433 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b0056e3d-a6e3-4679-827e-f016636b2fe8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:00.702235 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b0056e3d-a6e3-4679-827e-f016636b2fe8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:00.712263 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0056e3d-a6e3-4679-827e-f016636b2fe8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:00.712712 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0056e3d-a6e3-4679-827e-f016636b2fe8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:00.713554 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0056e3d-a6e3-4679-827e-f016636b2fe8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:00.716241 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0056e3d-a6e3-4679-827e-f016636b2fe8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:00.783095 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b0056e3d-a6e3-4679-827e-f016636b2fe8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:00.792302 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b0056e3d-a6e3-4679-827e-f016636b2fe8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.096570 Dec 15 14:25:00.792876 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1061/2044] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:00 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:01.810579 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4d928258-5151-4a0c-b88e-7b92511fdeaf tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:01.811207 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4d928258-5151-4a0c-b88e-7b92511fdeaf tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:01.818220 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d928258-5151-4a0c-b88e-7b92511fdeaf tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:01.818589 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d928258-5151-4a0c-b88e-7b92511fdeaf tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:01.819381 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d928258-5151-4a0c-b88e-7b92511fdeaf tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:01.819811 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d928258-5151-4a0c-b88e-7b92511fdeaf tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:01.880929 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4d928258-5151-4a0c-b88e-7b92511fdeaf tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:01.889693 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4d928258-5151-4a0c-b88e-7b92511fdeaf tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.082935 Dec 15 14:25:01.890281 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 984/2045] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:01 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:02.858678 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:25:02.859340 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:25:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:25:02.908081 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-336df855-e349-4ae8-8367-cd00a8a5b4e4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:02.908713 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-336df855-e349-4ae8-8367-cd00a8a5b4e4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:02.915804 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-336df855-e349-4ae8-8367-cd00a8a5b4e4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:02.916271 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-336df855-e349-4ae8-8367-cd00a8a5b4e4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:02.917083 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-336df855-e349-4ae8-8367-cd00a8a5b4e4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:02.917516 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-336df855-e349-4ae8-8367-cd00a8a5b4e4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:02.994826 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-336df855-e349-4ae8-8367-cd00a8a5b4e4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:03.004083 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-336df855-e349-4ae8-8367-cd00a8a5b4e4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.100510 Dec 15 14:25:03.004660 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1062/2046] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:02 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:04.024971 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-333313d1-b09b-4d7b-a81a-e9de36fcbd6c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:04.025657 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-333313d1-b09b-4d7b-a81a-e9de36fcbd6c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:04.033469 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-333313d1-b09b-4d7b-a81a-e9de36fcbd6c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:04.033945 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-333313d1-b09b-4d7b-a81a-e9de36fcbd6c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:04.034757 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-333313d1-b09b-4d7b-a81a-e9de36fcbd6c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:04.035187 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-333313d1-b09b-4d7b-a81a-e9de36fcbd6c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:04.100863 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-333313d1-b09b-4d7b-a81a-e9de36fcbd6c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:04.112400 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-333313d1-b09b-4d7b-a81a-e9de36fcbd6c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.091105 Dec 15 14:25:04.113413 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 985/2047] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:04 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:05.137122 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d81a1703-0e51-495e-b969-ad2b5a9b0121 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:05.137790 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d81a1703-0e51-495e-b969-ad2b5a9b0121 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:05.145025 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d81a1703-0e51-495e-b969-ad2b5a9b0121 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:05.145479 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d81a1703-0e51-495e-b969-ad2b5a9b0121 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:05.146348 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d81a1703-0e51-495e-b969-ad2b5a9b0121 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:05.146795 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d81a1703-0e51-495e-b969-ad2b5a9b0121 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:05.222060 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d81a1703-0e51-495e-b969-ad2b5a9b0121 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:05.231713 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d81a1703-0e51-495e-b969-ad2b5a9b0121 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.098321 Dec 15 14:25:05.232885 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1063/2048] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:05 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:06.251692 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1a435371-cd6e-44da-a6cb-e6955701f888 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:06.252470 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1a435371-cd6e-44da-a6cb-e6955701f888 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:06.259309 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a435371-cd6e-44da-a6cb-e6955701f888 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:06.259756 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a435371-cd6e-44da-a6cb-e6955701f888 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:06.260541 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a435371-cd6e-44da-a6cb-e6955701f888 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:06.261110 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a435371-cd6e-44da-a6cb-e6955701f888 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:06.332650 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1a435371-cd6e-44da-a6cb-e6955701f888 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:06.341183 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1a435371-cd6e-44da-a6cb-e6955701f888 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.093654 Dec 15 14:25:06.342010 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 986/2049] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:06 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:07.359081 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bfb74bc5-24c0-4bc4-8441-46b144076407 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:07.359723 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bfb74bc5-24c0-4bc4-8441-46b144076407 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:07.366400 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bfb74bc5-24c0-4bc4-8441-46b144076407 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:07.366980 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bfb74bc5-24c0-4bc4-8441-46b144076407 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:07.367838 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bfb74bc5-24c0-4bc4-8441-46b144076407 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:07.368455 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bfb74bc5-24c0-4bc4-8441-46b144076407 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:07.433120 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bfb74bc5-24c0-4bc4-8441-46b144076407 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:07.441577 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bfb74bc5-24c0-4bc4-8441-46b144076407 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.086242 Dec 15 14:25:07.442172 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1064/2050] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:07 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:08.462808 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4135c47f-e735-4a69-abee-8de59999fa22 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:08.463801 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4135c47f-e735-4a69-abee-8de59999fa22 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:08.475003 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4135c47f-e735-4a69-abee-8de59999fa22 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:08.475863 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4135c47f-e735-4a69-abee-8de59999fa22 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:08.477238 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4135c47f-e735-4a69-abee-8de59999fa22 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:08.477987 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4135c47f-e735-4a69-abee-8de59999fa22 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:08.550381 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4135c47f-e735-4a69-abee-8de59999fa22 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:08.558944 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4135c47f-e735-4a69-abee-8de59999fa22 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.103004 Dec 15 14:25:08.559520 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 987/2051] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:08 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:09.577737 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-de7cb849-55a9-4f34-a3cd-91e54fa93d18 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:09.578356 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-de7cb849-55a9-4f34-a3cd-91e54fa93d18 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:09.585651 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-de7cb849-55a9-4f34-a3cd-91e54fa93d18 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:09.586107 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-de7cb849-55a9-4f34-a3cd-91e54fa93d18 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:09.586943 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-de7cb849-55a9-4f34-a3cd-91e54fa93d18 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:09.587401 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-de7cb849-55a9-4f34-a3cd-91e54fa93d18 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:09.655216 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-de7cb849-55a9-4f34-a3cd-91e54fa93d18 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:09.663751 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-de7cb849-55a9-4f34-a3cd-91e54fa93d18 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.090142 Dec 15 14:25:09.664339 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1065/2052] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:09 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:10.681034 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f487f41e-9f88-47df-834b-2bcc3f729b54 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:10.681683 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f487f41e-9f88-47df-834b-2bcc3f729b54 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:10.689120 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f487f41e-9f88-47df-834b-2bcc3f729b54 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:10.689571 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f487f41e-9f88-47df-834b-2bcc3f729b54 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:10.690406 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f487f41e-9f88-47df-834b-2bcc3f729b54 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:10.690845 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f487f41e-9f88-47df-834b-2bcc3f729b54 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:10.755994 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f487f41e-9f88-47df-834b-2bcc3f729b54 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:10.764979 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f487f41e-9f88-47df-834b-2bcc3f729b54 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.087649 Dec 15 14:25:10.765830 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 988/2053] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:10 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:11.782716 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ee9249c8-aaa4-4403-ab63-f08e33970c04 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:11.783309 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ee9249c8-aaa4-4403-ab63-f08e33970c04 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:11.790554 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ee9249c8-aaa4-4403-ab63-f08e33970c04 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:11.790998 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ee9249c8-aaa4-4403-ab63-f08e33970c04 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:11.792299 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ee9249c8-aaa4-4403-ab63-f08e33970c04 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:11.792299 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ee9249c8-aaa4-4403-ab63-f08e33970c04 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:11.861564 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ee9249c8-aaa4-4403-ab63-f08e33970c04 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:11.870723 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ee9249c8-aaa4-4403-ab63-f08e33970c04 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.091730 Dec 15 14:25:11.871285 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1066/2054] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:11 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:12.888283 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7ebb5903-136f-4a3c-bdf4-1391d7fce4b3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:12.889126 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7ebb5903-136f-4a3c-bdf4-1391d7fce4b3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:12.896074 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ebb5903-136f-4a3c-bdf4-1391d7fce4b3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:12.896524 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ebb5903-136f-4a3c-bdf4-1391d7fce4b3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:12.897307 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ebb5903-136f-4a3c-bdf4-1391d7fce4b3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:12.897775 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ebb5903-136f-4a3c-bdf4-1391d7fce4b3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:12.962224 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7ebb5903-136f-4a3c-bdf4-1391d7fce4b3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:12.971235 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7ebb5903-136f-4a3c-bdf4-1391d7fce4b3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.086958 Dec 15 14:25:12.971792 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 989/2055] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:12 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:13.988246 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1b8c2e46-fe5b-476e-a4c0-4ce4326f0918 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:13.988931 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1b8c2e46-fe5b-476e-a4c0-4ce4326f0918 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:13.995827 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b8c2e46-fe5b-476e-a4c0-4ce4326f0918 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:13.996278 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b8c2e46-fe5b-476e-a4c0-4ce4326f0918 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:13.997059 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b8c2e46-fe5b-476e-a4c0-4ce4326f0918 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:13.997523 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b8c2e46-fe5b-476e-a4c0-4ce4326f0918 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:14.062075 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1b8c2e46-fe5b-476e-a4c0-4ce4326f0918 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:14.069871 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1b8c2e46-fe5b-476e-a4c0-4ce4326f0918 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.085408 Dec 15 14:25:14.070736 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1067/2056] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:13 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:15.087898 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fbf1b981-ad9a-48a9-ad2c-ec33ec485fc8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:15.088529 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fbf1b981-ad9a-48a9-ad2c-ec33ec485fc8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:15.095645 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fbf1b981-ad9a-48a9-ad2c-ec33ec485fc8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:15.096104 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fbf1b981-ad9a-48a9-ad2c-ec33ec485fc8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:15.096903 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fbf1b981-ad9a-48a9-ad2c-ec33ec485fc8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:15.097350 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fbf1b981-ad9a-48a9-ad2c-ec33ec485fc8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:15.161763 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fbf1b981-ad9a-48a9-ad2c-ec33ec485fc8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:15.170604 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fbf1b981-ad9a-48a9-ad2c-ec33ec485fc8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.086502 Dec 15 14:25:15.171180 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 990/2057] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:15 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:16.188653 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a5d4fc28-6b5f-428d-aa73-ec73b2077221 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:16.189290 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a5d4fc28-6b5f-428d-aa73-ec73b2077221 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:16.196455 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a5d4fc28-6b5f-428d-aa73-ec73b2077221 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:16.196907 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a5d4fc28-6b5f-428d-aa73-ec73b2077221 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:16.197737 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a5d4fc28-6b5f-428d-aa73-ec73b2077221 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:16.198172 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a5d4fc28-6b5f-428d-aa73-ec73b2077221 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:16.264452 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a5d4fc28-6b5f-428d-aa73-ec73b2077221 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:16.273014 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a5d4fc28-6b5f-428d-aa73-ec73b2077221 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.088839 Dec 15 14:25:16.273560 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1068/2058] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:16 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:17.552276 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-986967c5-148a-45e4-807f-94e31ca0654c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:17.553096 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-986967c5-148a-45e4-807f-94e31ca0654c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:17.560952 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-986967c5-148a-45e4-807f-94e31ca0654c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:17.561395 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-986967c5-148a-45e4-807f-94e31ca0654c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:17.562459 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-986967c5-148a-45e4-807f-94e31ca0654c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:17.562890 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-986967c5-148a-45e4-807f-94e31ca0654c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:17.630259 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-986967c5-148a-45e4-807f-94e31ca0654c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:17.640369 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-986967c5-148a-45e4-807f-94e31ca0654c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.352103 Dec 15 14:25:17.640969 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 991/2059] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:17 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:18.662703 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ff78079e-8d8b-464a-b923-25c3dc72b280 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:18.663352 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ff78079e-8d8b-464a-b923-25c3dc72b280 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:18.670336 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ff78079e-8d8b-464a-b923-25c3dc72b280 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:18.670781 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ff78079e-8d8b-464a-b923-25c3dc72b280 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:18.671669 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ff78079e-8d8b-464a-b923-25c3dc72b280 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:18.672128 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ff78079e-8d8b-464a-b923-25c3dc72b280 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:18.756977 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ff78079e-8d8b-464a-b923-25c3dc72b280 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:18.767846 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ff78079e-8d8b-464a-b923-25c3dc72b280 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.108617 Dec 15 14:25:18.769503 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1069/2060] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:18 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:19.787063 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-82b6a4d5-62ff-43c2-ac64-179b54c707ee tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:19.787650 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-82b6a4d5-62ff-43c2-ac64-179b54c707ee tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:19.795666 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-82b6a4d5-62ff-43c2-ac64-179b54c707ee tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:19.796115 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-82b6a4d5-62ff-43c2-ac64-179b54c707ee tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:19.796976 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-82b6a4d5-62ff-43c2-ac64-179b54c707ee tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:19.797414 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-82b6a4d5-62ff-43c2-ac64-179b54c707ee tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:19.863191 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-82b6a4d5-62ff-43c2-ac64-179b54c707ee tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:19.872035 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-82b6a4d5-62ff-43c2-ac64-179b54c707ee tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.088751 Dec 15 14:25:19.872754 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 992/2061] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:19 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:20.889936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7f9261fb-0f22-4fab-b7a0-65ee81549dee tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:20.890579 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7f9261fb-0f22-4fab-b7a0-65ee81549dee tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:20.897774 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7f9261fb-0f22-4fab-b7a0-65ee81549dee tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:20.898238 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7f9261fb-0f22-4fab-b7a0-65ee81549dee tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:20.899041 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7f9261fb-0f22-4fab-b7a0-65ee81549dee tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:20.899485 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7f9261fb-0f22-4fab-b7a0-65ee81549dee tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:20.966612 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7f9261fb-0f22-4fab-b7a0-65ee81549dee tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:20.975742 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7f9261fb-0f22-4fab-b7a0-65ee81549dee tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.089629 Dec 15 14:25:20.976338 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1070/2062] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:20 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:21.992719 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a2cf57bb-e04e-435d-981a-010331970a06 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:21.993302 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a2cf57bb-e04e-435d-981a-010331970a06 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:22.000204 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2cf57bb-e04e-435d-981a-010331970a06 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:22.000658 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2cf57bb-e04e-435d-981a-010331970a06 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:22.001444 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2cf57bb-e04e-435d-981a-010331970a06 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:22.001912 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2cf57bb-e04e-435d-981a-010331970a06 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:22.064822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a2cf57bb-e04e-435d-981a-010331970a06 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:22.073856 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a2cf57bb-e04e-435d-981a-010331970a06 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.084946 Dec 15 14:25:22.074426 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 993/2063] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:21 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:23.091138 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e475d46a-fe98-4647-941c-8ecf711831f4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:23.091969 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e475d46a-fe98-4647-941c-8ecf711831f4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:23.098734 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e475d46a-fe98-4647-941c-8ecf711831f4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:23.099186 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e475d46a-fe98-4647-941c-8ecf711831f4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:23.099968 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e475d46a-fe98-4647-941c-8ecf711831f4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:23.100402 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e475d46a-fe98-4647-941c-8ecf711831f4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:23.165565 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e475d46a-fe98-4647-941c-8ecf711831f4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:23.174677 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e475d46a-fe98-4647-941c-8ecf711831f4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.087345 Dec 15 14:25:23.175241 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1071/2064] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:23 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:24.192463 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-df4c1c24-d2bd-4b57-994a-3cc7035ea9d6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:24.193098 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-df4c1c24-d2bd-4b57-994a-3cc7035ea9d6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:24.200608 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df4c1c24-d2bd-4b57-994a-3cc7035ea9d6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:24.201082 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df4c1c24-d2bd-4b57-994a-3cc7035ea9d6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:24.201906 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df4c1c24-d2bd-4b57-994a-3cc7035ea9d6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:24.202346 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df4c1c24-d2bd-4b57-994a-3cc7035ea9d6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:24.265757 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-df4c1c24-d2bd-4b57-994a-3cc7035ea9d6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:24.274181 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-df4c1c24-d2bd-4b57-994a-3cc7035ea9d6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.085612 Dec 15 14:25:24.274752 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 994/2065] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:24 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:25.292435 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9abb2c4d-8669-4c74-b984-6eb75b4d8112 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:25.293173 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9abb2c4d-8669-4c74-b984-6eb75b4d8112 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:25.301027 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9abb2c4d-8669-4c74-b984-6eb75b4d8112 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:25.301549 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9abb2c4d-8669-4c74-b984-6eb75b4d8112 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:25.302370 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9abb2c4d-8669-4c74-b984-6eb75b4d8112 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:25.302832 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9abb2c4d-8669-4c74-b984-6eb75b4d8112 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:25.366604 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9abb2c4d-8669-4c74-b984-6eb75b4d8112 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:25.375174 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9abb2c4d-8669-4c74-b984-6eb75b4d8112 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.086496 Dec 15 14:25:25.375743 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1072/2066] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:25 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:26.392715 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a497e07f-9768-4b78-a790-9291708690cb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:26.393374 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a497e07f-9768-4b78-a790-9291708690cb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:26.400078 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a497e07f-9768-4b78-a790-9291708690cb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:26.400519 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a497e07f-9768-4b78-a790-9291708690cb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:26.401310 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a497e07f-9768-4b78-a790-9291708690cb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:26.401773 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a497e07f-9768-4b78-a790-9291708690cb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:26.467668 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a497e07f-9768-4b78-a790-9291708690cb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:26.476376 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a497e07f-9768-4b78-a790-9291708690cb tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.087519 Dec 15 14:25:26.476964 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 995/2067] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:26 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:27.494694 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-03e72714-7421-41b8-9acc-2c8f8462fd0b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:27.495348 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-03e72714-7421-41b8-9acc-2c8f8462fd0b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:27.502442 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03e72714-7421-41b8-9acc-2c8f8462fd0b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:27.502902 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03e72714-7421-41b8-9acc-2c8f8462fd0b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:27.503712 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03e72714-7421-41b8-9acc-2c8f8462fd0b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:27.504157 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03e72714-7421-41b8-9acc-2c8f8462fd0b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:27.569018 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-03e72714-7421-41b8-9acc-2c8f8462fd0b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:27.579195 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-03e72714-7421-41b8-9acc-2c8f8462fd0b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.088427 Dec 15 14:25:27.579774 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1073/2068] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:27 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:28.598474 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1568925a-0b9a-4503-93ad-87297779f36b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:28.599129 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1568925a-0b9a-4503-93ad-87297779f36b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:28.608669 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1568925a-0b9a-4503-93ad-87297779f36b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:28.609241 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1568925a-0b9a-4503-93ad-87297779f36b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:28.610196 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1568925a-0b9a-4503-93ad-87297779f36b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:28.610730 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1568925a-0b9a-4503-93ad-87297779f36b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:28.678650 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1568925a-0b9a-4503-93ad-87297779f36b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:28.687132 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1568925a-0b9a-4503-93ad-87297779f36b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.093157 Dec 15 14:25:28.687708 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 996/2069] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:28 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:29.706093 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f1c264a4-a0cc-47c0-9f94-b757b852d1f8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:29.706739 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f1c264a4-a0cc-47c0-9f94-b757b852d1f8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:29.713634 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1c264a4-a0cc-47c0-9f94-b757b852d1f8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:29.714121 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1c264a4-a0cc-47c0-9f94-b757b852d1f8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:29.714929 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1c264a4-a0cc-47c0-9f94-b757b852d1f8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:29.715723 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1c264a4-a0cc-47c0-9f94-b757b852d1f8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:29.782360 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f1c264a4-a0cc-47c0-9f94-b757b852d1f8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:29.791190 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f1c264a4-a0cc-47c0-9f94-b757b852d1f8 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.088871 Dec 15 14:25:29.791773 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1074/2070] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:29 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:30.808519 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4525a6f1-4490-40f2-9a39-6e7c9bf5b4d0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:30.809319 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4525a6f1-4490-40f2-9a39-6e7c9bf5b4d0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:30.820118 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4525a6f1-4490-40f2-9a39-6e7c9bf5b4d0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:30.820564 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4525a6f1-4490-40f2-9a39-6e7c9bf5b4d0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:30.821341 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4525a6f1-4490-40f2-9a39-6e7c9bf5b4d0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:30.821833 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4525a6f1-4490-40f2-9a39-6e7c9bf5b4d0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:30.887819 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4525a6f1-4490-40f2-9a39-6e7c9bf5b4d0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:30.896114 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4525a6f1-4490-40f2-9a39-6e7c9bf5b4d0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.091334 Dec 15 14:25:30.896679 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 997/2071] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:30 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:31.398464 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:25:31.398735 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:25:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:25:31.915156 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b28dceb4-6585-4e7e-a6c1-7f3a28c741a0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:31.916323 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b28dceb4-6585-4e7e-a6c1-7f3a28c741a0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:31.924931 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b28dceb4-6585-4e7e-a6c1-7f3a28c741a0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:31.925400 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b28dceb4-6585-4e7e-a6c1-7f3a28c741a0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:31.926280 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b28dceb4-6585-4e7e-a6c1-7f3a28c741a0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:31.926716 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b28dceb4-6585-4e7e-a6c1-7f3a28c741a0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:32.003294 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b28dceb4-6585-4e7e-a6c1-7f3a28c741a0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:32.012237 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b28dceb4-6585-4e7e-a6c1-7f3a28c741a0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.101658 Dec 15 14:25:32.013251 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1075/2072] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:31 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:33.030467 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-57c7dea7-f723-4261-a5b8-fafaf2d0d178 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:33.031163 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-57c7dea7-f723-4261-a5b8-fafaf2d0d178 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:33.038816 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57c7dea7-f723-4261-a5b8-fafaf2d0d178 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:33.039261 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57c7dea7-f723-4261-a5b8-fafaf2d0d178 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:33.040063 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57c7dea7-f723-4261-a5b8-fafaf2d0d178 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:33.040497 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57c7dea7-f723-4261-a5b8-fafaf2d0d178 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:33.107325 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-57c7dea7-f723-4261-a5b8-fafaf2d0d178 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:33.116359 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-57c7dea7-f723-4261-a5b8-fafaf2d0d178 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.089729 Dec 15 14:25:33.117004 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 998/2073] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:33 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:34.134537 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-47cb6ec7-55b7-4d46-9957-bb8728bdb5f3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:34.135417 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-47cb6ec7-55b7-4d46-9957-bb8728bdb5f3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:34.143389 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47cb6ec7-55b7-4d46-9957-bb8728bdb5f3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:34.143875 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47cb6ec7-55b7-4d46-9957-bb8728bdb5f3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:34.144672 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47cb6ec7-55b7-4d46-9957-bb8728bdb5f3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:34.145096 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47cb6ec7-55b7-4d46-9957-bb8728bdb5f3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:34.219549 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-47cb6ec7-55b7-4d46-9957-bb8728bdb5f3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:34.227809 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-47cb6ec7-55b7-4d46-9957-bb8728bdb5f3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.096925 Dec 15 14:25:34.228419 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1076/2074] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:34 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:35.246145 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5402da3a-dde5-4683-8226-1acaad4ffdc6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:35.247417 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5402da3a-dde5-4683-8226-1acaad4ffdc6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:35.254231 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5402da3a-dde5-4683-8226-1acaad4ffdc6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:35.254678 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5402da3a-dde5-4683-8226-1acaad4ffdc6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:35.255481 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5402da3a-dde5-4683-8226-1acaad4ffdc6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:35.255915 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5402da3a-dde5-4683-8226-1acaad4ffdc6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:35.319745 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5402da3a-dde5-4683-8226-1acaad4ffdc6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:35.328830 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5402da3a-dde5-4683-8226-1acaad4ffdc6 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.086531 Dec 15 14:25:35.329413 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 999/2075] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:35 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:36.346727 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e6bca1f5-0ac7-4c9e-9b27-17247552283a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:36.347350 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e6bca1f5-0ac7-4c9e-9b27-17247552283a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:36.354444 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6bca1f5-0ac7-4c9e-9b27-17247552283a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:36.354890 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6bca1f5-0ac7-4c9e-9b27-17247552283a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:36.355683 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6bca1f5-0ac7-4c9e-9b27-17247552283a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:36.356140 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6bca1f5-0ac7-4c9e-9b27-17247552283a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:36.454691 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e6bca1f5-0ac7-4c9e-9b27-17247552283a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:36.469471 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e6bca1f5-0ac7-4c9e-9b27-17247552283a tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.126052 Dec 15 14:25:36.470500 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1077/2076] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:36 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:37.488390 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-742283b8-293c-44f6-9a48-0f9a40b05de9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:37.489096 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-742283b8-293c-44f6-9a48-0f9a40b05de9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:37.496073 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-742283b8-293c-44f6-9a48-0f9a40b05de9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:37.496686 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-742283b8-293c-44f6-9a48-0f9a40b05de9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:37.502310 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-742283b8-293c-44f6-9a48-0f9a40b05de9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:37.502310 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-742283b8-293c-44f6-9a48-0f9a40b05de9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:37.839210 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-742283b8-293c-44f6-9a48-0f9a40b05de9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:37.847745 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-742283b8-293c-44f6-9a48-0f9a40b05de9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.363287 Dec 15 14:25:37.848344 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1000/2077] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:37 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:38.864978 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b26a9a76-d42c-47ba-8a89-d73d791e673c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:38.865698 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b26a9a76-d42c-47ba-8a89-d73d791e673c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:38.872290 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b26a9a76-d42c-47ba-8a89-d73d791e673c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:38.872791 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b26a9a76-d42c-47ba-8a89-d73d791e673c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:38.873579 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b26a9a76-d42c-47ba-8a89-d73d791e673c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:38.874044 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b26a9a76-d42c-47ba-8a89-d73d791e673c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:38.937559 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b26a9a76-d42c-47ba-8a89-d73d791e673c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:38.946557 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b26a9a76-d42c-47ba-8a89-d73d791e673c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.085289 Dec 15 14:25:38.947132 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1078/2078] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:38 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:39.969000 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-830a414d-65d0-4b3d-b5fd-734358e41def tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:39.969585 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-830a414d-65d0-4b3d-b5fd-734358e41def tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:39.976411 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-830a414d-65d0-4b3d-b5fd-734358e41def tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:39.976888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-830a414d-65d0-4b3d-b5fd-734358e41def tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:39.977724 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-830a414d-65d0-4b3d-b5fd-734358e41def tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:39.978156 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-830a414d-65d0-4b3d-b5fd-734358e41def tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:40.041174 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-830a414d-65d0-4b3d-b5fd-734358e41def tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:40.049809 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-830a414d-65d0-4b3d-b5fd-734358e41def tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.084873 Dec 15 14:25:40.050397 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1001/2079] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:39 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:41.068187 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f85e33cb-3f4f-4874-8b7a-0c9d2345e872 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:41.068789 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f85e33cb-3f4f-4874-8b7a-0c9d2345e872 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:41.076241 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f85e33cb-3f4f-4874-8b7a-0c9d2345e872 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:41.076693 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f85e33cb-3f4f-4874-8b7a-0c9d2345e872 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:41.077477 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f85e33cb-3f4f-4874-8b7a-0c9d2345e872 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:41.077959 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f85e33cb-3f4f-4874-8b7a-0c9d2345e872 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:41.140529 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f85e33cb-3f4f-4874-8b7a-0c9d2345e872 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:41.148749 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f85e33cb-3f4f-4874-8b7a-0c9d2345e872 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.084377 Dec 15 14:25:41.149353 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1079/2080] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:41 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:42.166201 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bd3973d2-5ecd-43f3-9836-b46fedcdad71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:42.166823 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bd3973d2-5ecd-43f3-9836-b46fedcdad71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:42.173817 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bd3973d2-5ecd-43f3-9836-b46fedcdad71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:42.174272 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bd3973d2-5ecd-43f3-9836-b46fedcdad71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:42.175231 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bd3973d2-5ecd-43f3-9836-b46fedcdad71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:42.175500 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bd3973d2-5ecd-43f3-9836-b46fedcdad71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:42.240006 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bd3973d2-5ecd-43f3-9836-b46fedcdad71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:42.248736 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bd3973d2-5ecd-43f3-9836-b46fedcdad71 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.086192 Dec 15 14:25:42.249321 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1002/2081] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:42 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:43.266626 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dfcd6b4c-85a7-465f-988b-3d50a67df540 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:43.267433 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dfcd6b4c-85a7-465f-988b-3d50a67df540 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:43.274166 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dfcd6b4c-85a7-465f-988b-3d50a67df540 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:43.274606 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dfcd6b4c-85a7-465f-988b-3d50a67df540 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:43.275408 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dfcd6b4c-85a7-465f-988b-3d50a67df540 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:43.275835 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dfcd6b4c-85a7-465f-988b-3d50a67df540 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:43.350510 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dfcd6b4c-85a7-465f-988b-3d50a67df540 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:43.359112 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dfcd6b4c-85a7-465f-988b-3d50a67df540 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.096298 Dec 15 14:25:43.359722 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1080/2082] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:43 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:44.377658 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ce9ab144-6a38-4735-8adb-2d588809c24e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:44.378348 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ce9ab144-6a38-4735-8adb-2d588809c24e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:44.385215 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce9ab144-6a38-4735-8adb-2d588809c24e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:44.385690 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce9ab144-6a38-4735-8adb-2d588809c24e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:44.386481 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce9ab144-6a38-4735-8adb-2d588809c24e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:44.387054 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce9ab144-6a38-4735-8adb-2d588809c24e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:44.453590 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ce9ab144-6a38-4735-8adb-2d588809c24e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:44.461732 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ce9ab144-6a38-4735-8adb-2d588809c24e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.087848 Dec 15 14:25:44.462272 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1003/2083] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:44 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:45.479452 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9ba45ef5-7325-4f0f-abdb-9dc9a7c19aa9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:45.480098 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9ba45ef5-7325-4f0f-abdb-9dc9a7c19aa9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:45.487254 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ba45ef5-7325-4f0f-abdb-9dc9a7c19aa9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:45.487679 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ba45ef5-7325-4f0f-abdb-9dc9a7c19aa9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:45.488477 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ba45ef5-7325-4f0f-abdb-9dc9a7c19aa9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:45.488919 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ba45ef5-7325-4f0f-abdb-9dc9a7c19aa9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:45.550883 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9ba45ef5-7325-4f0f-abdb-9dc9a7c19aa9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:45.559712 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9ba45ef5-7325-4f0f-abdb-9dc9a7c19aa9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.084255 Dec 15 14:25:45.560289 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1081/2084] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:45 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:46.578223 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0da268c3-bbc4-4d36-aa4c-75bc217d0c09 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:46.578983 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0da268c3-bbc4-4d36-aa4c-75bc217d0c09 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:46.586018 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0da268c3-bbc4-4d36-aa4c-75bc217d0c09 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:46.586446 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0da268c3-bbc4-4d36-aa4c-75bc217d0c09 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:46.587258 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0da268c3-bbc4-4d36-aa4c-75bc217d0c09 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:46.587680 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0da268c3-bbc4-4d36-aa4c-75bc217d0c09 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:46.660149 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0da268c3-bbc4-4d36-aa4c-75bc217d0c09 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:46.669041 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0da268c3-bbc4-4d36-aa4c-75bc217d0c09 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.094820 Dec 15 14:25:46.669658 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1004/2085] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:46 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:47.692969 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d0a784e7-d3fe-4aee-b45a-9449d85b4e1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:47.694235 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d0a784e7-d3fe-4aee-b45a-9449d85b4e1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:47.703988 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0a784e7-d3fe-4aee-b45a-9449d85b4e1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:47.704623 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0a784e7-d3fe-4aee-b45a-9449d85b4e1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:47.705973 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0a784e7-d3fe-4aee-b45a-9449d85b4e1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:47.706689 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0a784e7-d3fe-4aee-b45a-9449d85b4e1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:47.782554 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d0a784e7-d3fe-4aee-b45a-9449d85b4e1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:47.791417 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d0a784e7-d3fe-4aee-b45a-9449d85b4e1b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.104618 Dec 15 14:25:47.792009 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1082/2086] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:47 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:48.810232 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ee067445-8823-48f6-a645-e06400c5786c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:48.810851 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ee067445-8823-48f6-a645-e06400c5786c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:48.817953 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee067445-8823-48f6-a645-e06400c5786c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:48.818593 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee067445-8823-48f6-a645-e06400c5786c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:48.819804 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee067445-8823-48f6-a645-e06400c5786c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:48.820346 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee067445-8823-48f6-a645-e06400c5786c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:48.884451 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ee067445-8823-48f6-a645-e06400c5786c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:48.899299 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ee067445-8823-48f6-a645-e06400c5786c tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.092533 Dec 15 14:25:48.900288 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1005/2087] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:48 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:49.927901 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-987e725b-6eb9-436f-ad10-5c8df9f5a186 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:49.928800 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-987e725b-6eb9-436f-ad10-5c8df9f5a186 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:49.939673 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-987e725b-6eb9-436f-ad10-5c8df9f5a186 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:49.940405 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-987e725b-6eb9-436f-ad10-5c8df9f5a186 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:49.941721 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-987e725b-6eb9-436f-ad10-5c8df9f5a186 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:49.942449 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-987e725b-6eb9-436f-ad10-5c8df9f5a186 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:50.021685 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-987e725b-6eb9-436f-ad10-5c8df9f5a186 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:50.030920 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-987e725b-6eb9-436f-ad10-5c8df9f5a186 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.109670 Dec 15 14:25:50.031511 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1083/2088] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:49 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:51.047945 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cb4619a0-7a2f-4111-a2ce-d7719cc051f2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:51.048550 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cb4619a0-7a2f-4111-a2ce-d7719cc051f2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:51.055942 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb4619a0-7a2f-4111-a2ce-d7719cc051f2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:51.056389 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb4619a0-7a2f-4111-a2ce-d7719cc051f2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:51.057161 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb4619a0-7a2f-4111-a2ce-d7719cc051f2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:51.057654 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb4619a0-7a2f-4111-a2ce-d7719cc051f2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:51.125203 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cb4619a0-7a2f-4111-a2ce-d7719cc051f2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:51.133711 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cb4619a0-7a2f-4111-a2ce-d7719cc051f2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.089611 Dec 15 14:25:51.134291 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1006/2089] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:51 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:52.151695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b994e978-b371-421b-8155-99ed9e5a05d4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:52.152400 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b994e978-b371-421b-8155-99ed9e5a05d4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:52.159785 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b994e978-b371-421b-8155-99ed9e5a05d4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:52.160276 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b994e978-b371-421b-8155-99ed9e5a05d4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:52.161173 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b994e978-b371-421b-8155-99ed9e5a05d4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:52.161697 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b994e978-b371-421b-8155-99ed9e5a05d4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:52.224419 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b994e978-b371-421b-8155-99ed9e5a05d4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:52.233028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b994e978-b371-421b-8155-99ed9e5a05d4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.085123 Dec 15 14:25:52.233625 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1084/2090] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:52 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:53.250983 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d2a4a1dc-01fd-4bcf-b586-122a4999d8fe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:53.251733 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d2a4a1dc-01fd-4bcf-b586-122a4999d8fe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:53.258548 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d2a4a1dc-01fd-4bcf-b586-122a4999d8fe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:53.259019 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d2a4a1dc-01fd-4bcf-b586-122a4999d8fe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:53.259780 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d2a4a1dc-01fd-4bcf-b586-122a4999d8fe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:53.260210 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d2a4a1dc-01fd-4bcf-b586-122a4999d8fe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:53.324059 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d2a4a1dc-01fd-4bcf-b586-122a4999d8fe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:53.332693 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d2a4a1dc-01fd-4bcf-b586-122a4999d8fe tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.086038 Dec 15 14:25:53.333276 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1007/2091] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:53 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:54.350134 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2764b080-58ca-48cc-885a-acd18ee46c12 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:54.350804 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2764b080-58ca-48cc-885a-acd18ee46c12 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:54.357624 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2764b080-58ca-48cc-885a-acd18ee46c12 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:54.358123 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2764b080-58ca-48cc-885a-acd18ee46c12 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:54.358911 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2764b080-58ca-48cc-885a-acd18ee46c12 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:54.359350 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2764b080-58ca-48cc-885a-acd18ee46c12 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:54.421952 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2764b080-58ca-48cc-885a-acd18ee46c12 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:54.430207 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2764b080-58ca-48cc-885a-acd18ee46c12 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.083765 Dec 15 14:25:54.430793 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1085/2092] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:54 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:55.447951 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d6c27553-a90c-4213-b55f-bc0fa145414f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:55.448735 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d6c27553-a90c-4213-b55f-bc0fa145414f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:55.456774 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d6c27553-a90c-4213-b55f-bc0fa145414f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:55.457225 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d6c27553-a90c-4213-b55f-bc0fa145414f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:55.458038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d6c27553-a90c-4213-b55f-bc0fa145414f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:55.458508 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d6c27553-a90c-4213-b55f-bc0fa145414f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:55.523401 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d6c27553-a90c-4213-b55f-bc0fa145414f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:55.531693 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d6c27553-a90c-4213-b55f-bc0fa145414f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.087868 Dec 15 14:25:55.532256 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1008/2093] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:55 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:56.551957 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f1add003-6c0a-4248-b5fe-5b83a403d7a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:56.553047 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f1add003-6c0a-4248-b5fe-5b83a403d7a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:56.564658 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1add003-6c0a-4248-b5fe-5b83a403d7a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:56.565461 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1add003-6c0a-4248-b5fe-5b83a403d7a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:56.566858 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1add003-6c0a-4248-b5fe-5b83a403d7a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:56.568095 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1add003-6c0a-4248-b5fe-5b83a403d7a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:56.639014 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f1add003-6c0a-4248-b5fe-5b83a403d7a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:56.648984 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f1add003-6c0a-4248-b5fe-5b83a403d7a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.103655 Dec 15 14:25:56.649680 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1086/2094] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:56 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:57.667629 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-502741a6-21b6-4dab-aa89-25976a3270a9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:57.668410 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-502741a6-21b6-4dab-aa89-25976a3270a9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:57.675383 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-502741a6-21b6-4dab-aa89-25976a3270a9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:57.675829 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-502741a6-21b6-4dab-aa89-25976a3270a9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:57.676667 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-502741a6-21b6-4dab-aa89-25976a3270a9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:57.677096 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-502741a6-21b6-4dab-aa89-25976a3270a9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:57.741298 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-502741a6-21b6-4dab-aa89-25976a3270a9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:57.749847 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-502741a6-21b6-4dab-aa89-25976a3270a9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.086141 Dec 15 14:25:57.750443 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1009/2095] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:57 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:58.767034 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-341224ae-e7d8-4679-ae6f-b2a848327053 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:58.767661 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-341224ae-e7d8-4679-ae6f-b2a848327053 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:58.774722 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-341224ae-e7d8-4679-ae6f-b2a848327053 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:58.775164 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-341224ae-e7d8-4679-ae6f-b2a848327053 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:58.775937 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-341224ae-e7d8-4679-ae6f-b2a848327053 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:58.776380 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-341224ae-e7d8-4679-ae6f-b2a848327053 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:58.839818 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-341224ae-e7d8-4679-ae6f-b2a848327053 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:58.848640 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-341224ae-e7d8-4679-ae6f-b2a848327053 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.085304 Dec 15 14:25:58.849205 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1087/2096] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:58 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:25:59.866552 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-946bbaf7-7a0a-47a9-a0bf-9c81d5d570c9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:25:59.867197 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-946bbaf7-7a0a-47a9-a0bf-9c81d5d570c9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:25:59.874214 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-946bbaf7-7a0a-47a9-a0bf-9c81d5d570c9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:59.874663 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-946bbaf7-7a0a-47a9-a0bf-9c81d5d570c9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:59.875457 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-946bbaf7-7a0a-47a9-a0bf-9c81d5d570c9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:25:59.875890 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-946bbaf7-7a0a-47a9-a0bf-9c81d5d570c9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:25:59.939935 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-946bbaf7-7a0a-47a9-a0bf-9c81d5d570c9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:25:59.948986 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-946bbaf7-7a0a-47a9-a0bf-9c81d5d570c9 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.086324 Dec 15 14:25:59.949943 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1010/2097] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:25:59 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:00.967239 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-71ff66c7-f314-4bf4-be23-646d2234610d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:00.967818 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-71ff66c7-f314-4bf4-be23-646d2234610d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:00.974721 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71ff66c7-f314-4bf4-be23-646d2234610d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:00.975161 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71ff66c7-f314-4bf4-be23-646d2234610d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:00.975936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71ff66c7-f314-4bf4-be23-646d2234610d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:00.976363 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71ff66c7-f314-4bf4-be23-646d2234610d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:01.039454 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-71ff66c7-f314-4bf4-be23-646d2234610d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:01.047838 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-71ff66c7-f314-4bf4-be23-646d2234610d tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.084477 Dec 15 14:26:01.048407 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1088/2098] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:00 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:02.066085 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e40a5655-5481-4fef-9503-4fce6ab3feec tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:02.066647 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e40a5655-5481-4fef-9503-4fce6ab3feec tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:02.075711 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e40a5655-5481-4fef-9503-4fce6ab3feec tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:02.076156 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e40a5655-5481-4fef-9503-4fce6ab3feec tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:02.077018 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e40a5655-5481-4fef-9503-4fce6ab3feec tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:02.077469 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e40a5655-5481-4fef-9503-4fce6ab3feec tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:02.143287 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e40a5655-5481-4fef-9503-4fce6ab3feec tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:02.153003 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e40a5655-5481-4fef-9503-4fce6ab3feec tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.090301 Dec 15 14:26:02.153639 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1011/2099] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:02 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:03.171532 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-772302e8-2e26-491e-a42a-4e939267f9cc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:03.172147 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-772302e8-2e26-491e-a42a-4e939267f9cc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:03.179002 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-772302e8-2e26-491e-a42a-4e939267f9cc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:03.179455 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-772302e8-2e26-491e-a42a-4e939267f9cc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:03.180247 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-772302e8-2e26-491e-a42a-4e939267f9cc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:03.180685 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-772302e8-2e26-491e-a42a-4e939267f9cc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:03.249312 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-772302e8-2e26-491e-a42a-4e939267f9cc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:03.257811 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-772302e8-2e26-491e-a42a-4e939267f9cc tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.090181 Dec 15 14:26:03.258360 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1089/2100] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:03 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:04.277281 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5e746bbe-7dbb-49b2-9f65-206e10c0c467 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:04.278269 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5e746bbe-7dbb-49b2-9f65-206e10c0c467 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:04.284249 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e746bbe-7dbb-49b2-9f65-206e10c0c467 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:04.284704 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e746bbe-7dbb-49b2-9f65-206e10c0c467 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:04.285489 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e746bbe-7dbb-49b2-9f65-206e10c0c467 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:04.285969 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e746bbe-7dbb-49b2-9f65-206e10c0c467 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:04.353861 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5e746bbe-7dbb-49b2-9f65-206e10c0c467 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:04.367584 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5e746bbe-7dbb-49b2-9f65-206e10c0c467 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.094952 Dec 15 14:26:04.368182 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1012/2101] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:04 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:05.384409 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-66091231-3111-4aa6-bbd0-c2eca9a9940e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:05.385010 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-66091231-3111-4aa6-bbd0-c2eca9a9940e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:05.392052 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66091231-3111-4aa6-bbd0-c2eca9a9940e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:05.392600 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66091231-3111-4aa6-bbd0-c2eca9a9940e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:05.393393 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66091231-3111-4aa6-bbd0-c2eca9a9940e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:05.393976 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66091231-3111-4aa6-bbd0-c2eca9a9940e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:05.457073 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-66091231-3111-4aa6-bbd0-c2eca9a9940e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:05.465324 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-66091231-3111-4aa6-bbd0-c2eca9a9940e tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.084640 Dec 15 14:26:05.465923 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1090/2102] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:05 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:26:06.483582 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f4d046b6-d6e8-4279-b1b9-ce1397b35a70 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:06.484271 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f4d046b6-d6e8-4279-b1b9-ce1397b35a70 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:06.490647 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4d046b6-d6e8-4279-b1b9-ce1397b35a70 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:06.491095 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4d046b6-d6e8-4279-b1b9-ce1397b35a70 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:06.491904 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4d046b6-d6e8-4279-b1b9-ce1397b35a70 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:06.492336 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4d046b6-d6e8-4279-b1b9-ce1397b35a70 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:06.562447 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f4d046b6-d6e8-4279-b1b9-ce1397b35a70 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:06.570838 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f4d046b6-d6e8-4279-b1b9-ce1397b35a70 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.091403 Dec 15 14:26:06.571429 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1013/2103] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:06 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:07.589753 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a86dc6e3-d2a0-41c2-8c28-8bdcac874f0f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:07.590649 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a86dc6e3-d2a0-41c2-8c28-8bdcac874f0f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:07.601536 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a86dc6e3-d2a0-41c2-8c28-8bdcac874f0f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:07.602115 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a86dc6e3-d2a0-41c2-8c28-8bdcac874f0f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:07.602994 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a86dc6e3-d2a0-41c2-8c28-8bdcac874f0f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:07.603473 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a86dc6e3-d2a0-41c2-8c28-8bdcac874f0f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:07.678718 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a86dc6e3-d2a0-41c2-8c28-8bdcac874f0f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:07.686965 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a86dc6e3-d2a0-41c2-8c28-8bdcac874f0f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.101982 Dec 15 14:26:07.687547 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1091/2104] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:07 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:08.705013 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-09bf5d2b-0dc8-4a58-8a18-af1aa12b9d77 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:08.705727 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-09bf5d2b-0dc8-4a58-8a18-af1aa12b9d77 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:08.712823 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-09bf5d2b-0dc8-4a58-8a18-af1aa12b9d77 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:08.713243 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-09bf5d2b-0dc8-4a58-8a18-af1aa12b9d77 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:08.714078 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-09bf5d2b-0dc8-4a58-8a18-af1aa12b9d77 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:08.714697 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-09bf5d2b-0dc8-4a58-8a18-af1aa12b9d77 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:08.778818 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-09bf5d2b-0dc8-4a58-8a18-af1aa12b9d77 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:08.787221 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-09bf5d2b-0dc8-4a58-8a18-af1aa12b9d77 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.085976 Dec 15 14:26:08.787792 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1014/2105] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:08 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:09.805276 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-74028e1b-fe0c-4d31-902f-2d6e95f16f00 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:09.805913 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-74028e1b-fe0c-4d31-902f-2d6e95f16f00 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:09.813201 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-74028e1b-fe0c-4d31-902f-2d6e95f16f00 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:09.813658 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-74028e1b-fe0c-4d31-902f-2d6e95f16f00 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:09.814501 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-74028e1b-fe0c-4d31-902f-2d6e95f16f00 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:09.814939 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-74028e1b-fe0c-4d31-902f-2d6e95f16f00 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:09.883939 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-74028e1b-fe0c-4d31-902f-2d6e95f16f00 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:09.892833 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-74028e1b-fe0c-4d31-902f-2d6e95f16f00 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.091280 Dec 15 14:26:09.893408 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1092/2106] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:09 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:10.910323 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-44da21e6-16c7-4d2b-b507-b16ebb777c82 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:10.910943 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-44da21e6-16c7-4d2b-b507-b16ebb777c82 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:10.917598 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-44da21e6-16c7-4d2b-b507-b16ebb777c82 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:10.918139 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-44da21e6-16c7-4d2b-b507-b16ebb777c82 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:10.918937 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-44da21e6-16c7-4d2b-b507-b16ebb777c82 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:10.919340 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-44da21e6-16c7-4d2b-b507-b16ebb777c82 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:10.984333 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-44da21e6-16c7-4d2b-b507-b16ebb777c82 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:10.993070 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-44da21e6-16c7-4d2b-b507-b16ebb777c82 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.086522 Dec 15 14:26:10.993704 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1015/2107] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:10 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:12.013274 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-04446d71-de71-46b0-8753-55ede8964a60 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:12.014167 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-04446d71-de71-46b0-8753-55ede8964a60 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:12.021163 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-04446d71-de71-46b0-8753-55ede8964a60 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:12.021656 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-04446d71-de71-46b0-8753-55ede8964a60 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:12.022676 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-04446d71-de71-46b0-8753-55ede8964a60 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:12.023045 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-04446d71-de71-46b0-8753-55ede8964a60 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:12.088307 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-04446d71-de71-46b0-8753-55ede8964a60 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:12.097063 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-04446d71-de71-46b0-8753-55ede8964a60 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.089612 Dec 15 14:26:12.097668 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1093/2108] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:12 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:13.115153 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4aa3b3d0-cc69-4ed5-aed4-295a28171926 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:13.115880 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4aa3b3d0-cc69-4ed5-aed4-295a28171926 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:13.123033 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4aa3b3d0-cc69-4ed5-aed4-295a28171926 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:13.123481 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4aa3b3d0-cc69-4ed5-aed4-295a28171926 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:13.124279 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4aa3b3d0-cc69-4ed5-aed4-295a28171926 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:13.124714 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4aa3b3d0-cc69-4ed5-aed4-295a28171926 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:13.194636 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4aa3b3d0-cc69-4ed5-aed4-295a28171926 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:13.203471 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4aa3b3d0-cc69-4ed5-aed4-295a28171926 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.092374 Dec 15 14:26:13.204034 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1016/2109] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:13 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:14.221793 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cf5d5403-03af-4113-a5d4-ac8eda1ba9a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:14.222483 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cf5d5403-03af-4113-a5d4-ac8eda1ba9a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:14.229384 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf5d5403-03af-4113-a5d4-ac8eda1ba9a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:14.229866 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf5d5403-03af-4113-a5d4-ac8eda1ba9a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:14.230807 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf5d5403-03af-4113-a5d4-ac8eda1ba9a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:14.231338 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf5d5403-03af-4113-a5d4-ac8eda1ba9a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:14.305213 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cf5d5403-03af-4113-a5d4-ac8eda1ba9a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:14.313761 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cf5d5403-03af-4113-a5d4-ac8eda1ba9a4 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.096225 Dec 15 14:26:14.314336 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1094/2110] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:14 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:26:15.333244 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fd59a4a8-6035-466d-8daf-bb486bd50cc2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:15.333916 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fd59a4a8-6035-466d-8daf-bb486bd50cc2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:15.341027 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd59a4a8-6035-466d-8daf-bb486bd50cc2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:15.341482 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd59a4a8-6035-466d-8daf-bb486bd50cc2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:15.342423 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd59a4a8-6035-466d-8daf-bb486bd50cc2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:15.342872 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd59a4a8-6035-466d-8daf-bb486bd50cc2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:15.408921 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fd59a4a8-6035-466d-8daf-bb486bd50cc2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:15.420960 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fd59a4a8-6035-466d-8daf-bb486bd50cc2 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.091933 Dec 15 14:26:15.421545 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1017/2111] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:15 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:16.438584 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fd6bc4ee-1f4d-40c4-88c6-7c1e54a7a4fd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:16.439214 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fd6bc4ee-1f4d-40c4-88c6-7c1e54a7a4fd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:16.446986 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd6bc4ee-1f4d-40c4-88c6-7c1e54a7a4fd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:16.447501 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd6bc4ee-1f4d-40c4-88c6-7c1e54a7a4fd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:16.448559 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd6bc4ee-1f4d-40c4-88c6-7c1e54a7a4fd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:16.449067 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd6bc4ee-1f4d-40c4-88c6-7c1e54a7a4fd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:16.519177 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fd6bc4ee-1f4d-40c4-88c6-7c1e54a7a4fd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:16.529300 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fd6bc4ee-1f4d-40c4-88c6-7c1e54a7a4fd tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.094953 Dec 15 14:26:16.530193 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1095/2112] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:16 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:17.548204 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-96b23675-6c56-4d0b-bf34-3b230bffb50b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:17.548847 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-96b23675-6c56-4d0b-bf34-3b230bffb50b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:17.555970 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96b23675-6c56-4d0b-bf34-3b230bffb50b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:17.556562 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96b23675-6c56-4d0b-bf34-3b230bffb50b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:17.557987 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96b23675-6c56-4d0b-bf34-3b230bffb50b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:17.558654 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96b23675-6c56-4d0b-bf34-3b230bffb50b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:17.626359 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-96b23675-6c56-4d0b-bf34-3b230bffb50b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:17.639867 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-96b23675-6c56-4d0b-bf34-3b230bffb50b tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.095049 Dec 15 14:26:17.640872 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1018/2113] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:17 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:18.657942 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ed18e9e1-92d0-40fd-b755-436694b0bea0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:18.658622 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ed18e9e1-92d0-40fd-b755-436694b0bea0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:18.666817 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ed18e9e1-92d0-40fd-b755-436694b0bea0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:18.667284 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ed18e9e1-92d0-40fd-b755-436694b0bea0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:18.668093 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ed18e9e1-92d0-40fd-b755-436694b0bea0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:18.668534 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ed18e9e1-92d0-40fd-b755-436694b0bea0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:18.681595 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d23c63bf-4340-4882-9518-96ffcd902fb4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:18.682330 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d23c63bf-4340-4882-9518-96ffcd902fb4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:18.690626 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d23c63bf-4340-4882-9518-96ffcd902fb4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:18.691075 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d23c63bf-4340-4882-9518-96ffcd902fb4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:18.691889 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d23c63bf-4340-4882-9518-96ffcd902fb4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:18.692339 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d23c63bf-4340-4882-9518-96ffcd902fb4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:18.731061 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d23c63bf-4340-4882-9518-96ffcd902fb4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:26:18.748473 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ed18e9e1-92d0-40fd-b755-436694b0bea0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:18.757655 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ed18e9e1-92d0-40fd-b755-436694b0bea0 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.103276 Dec 15 14:26:18.758802 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1096/2114] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:18 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:18.831739 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d23c63bf-4340-4882-9518-96ffcd902fb4 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9" status: 204 len: 0 microversion: 2.1 time: 0.154285 Dec 15 14:26:18.832417 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1019/2115] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:26:18 2021] DELETE /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:26:18.840897 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-907156d0-875c-4b34-b10b-433b0801446a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:18.841735 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-907156d0-875c-4b34-b10b-433b0801446a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:18.848063 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-907156d0-875c-4b34-b10b-433b0801446a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:18.849444 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-907156d0-875c-4b34-b10b-433b0801446a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:18.849444 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-907156d0-875c-4b34-b10b-433b0801446a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:18.849815 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-907156d0-875c-4b34-b10b-433b0801446a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:19.008682 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-907156d0-875c-4b34-b10b-433b0801446a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:19.016745 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-907156d0-875c-4b34-b10b-433b0801446a tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9" status: 200 len: 1673 microversion: 2.1 time: 0.179630 Dec 15 14:26:19.017337 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1097/2116] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:18 2021] GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 => generated 1673 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:19.776377 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-58046547-27b9-49ad-aa23-9a12e2c078ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:19.778353 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-58046547-27b9-49ad-aa23-9a12e2c078ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:19.786508 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-58046547-27b9-49ad-aa23-9a12e2c078ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:19.786960 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-58046547-27b9-49ad-aa23-9a12e2c078ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:19.787763 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-58046547-27b9-49ad-aa23-9a12e2c078ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:19.788202 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-58046547-27b9-49ad-aa23-9a12e2c078ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:19.890813 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-58046547-27b9-49ad-aa23-9a12e2c078ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:19.899466 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-58046547-27b9-49ad-aa23-9a12e2c078ff tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.127084 Dec 15 14:26:19.900075 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1020/2117] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:19 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:20.034261 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b72ad9b1-4874-464c-957f-49afa76bcfc3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:20.034850 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b72ad9b1-4874-464c-957f-49afa76bcfc3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:20.042144 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b72ad9b1-4874-464c-957f-49afa76bcfc3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:20.042625 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b72ad9b1-4874-464c-957f-49afa76bcfc3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:20.043451 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b72ad9b1-4874-464c-957f-49afa76bcfc3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:20.043916 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b72ad9b1-4874-464c-957f-49afa76bcfc3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:20.315005 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b72ad9b1-4874-464c-957f-49afa76bcfc3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:20.324125 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b72ad9b1-4874-464c-957f-49afa76bcfc3 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9" status: 200 len: 1673 microversion: 2.1 time: 0.293658 Dec 15 14:26:20.324902 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1098/2118] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:20 2021] GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 => generated 1673 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:20.828977 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-b7a9f1ec-ebcf-43da-bcca-d195c9a27b6d req-91387c72-cbad-4a13-b95c-15d83bcd6351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9", "name": "network-vif-deleted", "tag": "88814554-f9b3-47cc-bddd-5c6dc6942720"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:26:20.831486 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:26:20.831486 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:26:20.845891 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-b7a9f1ec-ebcf-43da-bcca-d195c9a27b6d req-91387c72-cbad-4a13-b95c-15d83bcd6351 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:20.846516 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-b7a9f1ec-ebcf-43da-bcca-d195c9a27b6d req-91387c72-cbad-4a13-b95c-15d83bcd6351 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:20.865554 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-b7a9f1ec-ebcf-43da-bcca-d195c9a27b6d req-91387c72-cbad-4a13-b95c-15d83bcd6351 service nova] Creating event network-vif-deleted:88814554-f9b3-47cc-bddd-5c6dc6942720 for instance f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 on hv-cinder-82182 Dec 15 14:26:20.879219 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-b7a9f1ec-ebcf-43da-bcca-d195c9a27b6d req-91387c72-cbad-4a13-b95c-15d83bcd6351 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053800 Dec 15 14:26:20.879948 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1021/2119] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:26:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:26:20.918855 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4feb67ea-97de-4bc8-bb8a-7d9d8adbfe44 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:20.919786 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4feb67ea-97de-4bc8-bb8a-7d9d8adbfe44 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:20.927175 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4feb67ea-97de-4bc8-bb8a-7d9d8adbfe44 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:20.928029 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4feb67ea-97de-4bc8-bb8a-7d9d8adbfe44 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:20.929109 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4feb67ea-97de-4bc8-bb8a-7d9d8adbfe44 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:20.929938 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4feb67ea-97de-4bc8-bb8a-7d9d8adbfe44 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:21.006829 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4feb67ea-97de-4bc8-bb8a-7d9d8adbfe44 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:21.019202 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4feb67ea-97de-4bc8-bb8a-7d9d8adbfe44 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.104261 Dec 15 14:26:21.019901 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1099/2120] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:20 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:21.344152 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9ccdf180-79e5-452b-8d80-cbad77b2f259 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:21.344956 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9ccdf180-79e5-452b-8d80-cbad77b2f259 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:21.355644 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ccdf180-79e5-452b-8d80-cbad77b2f259 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:21.356094 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ccdf180-79e5-452b-8d80-cbad77b2f259 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:21.357042 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ccdf180-79e5-452b-8d80-cbad77b2f259 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:21.357993 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ccdf180-79e5-452b-8d80-cbad77b2f259 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:21.407005 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ccdf180-79e5-452b-8d80-cbad77b2f259 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:21.407447 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ccdf180-79e5-452b-8d80-cbad77b2f259 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:21.407897 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-9ccdf180-79e5-452b-8d80-cbad77b2f259 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lazy-loading 'fault' on Instance uuid f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:26:21.454813 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9ccdf180-79e5-452b-8d80-cbad77b2f259 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c5d857247f4fbabae43f49d3644d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db115a6a96f249a88a86dc25569d6ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:21.461839 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9ccdf180-79e5-452b-8d80-cbad77b2f259 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9" status: 200 len: 1327 microversion: 2.1 time: 0.122983 Dec 15 14:26:21.462467 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1022/2121] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:21 2021] GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 => generated 1327 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:22.042712 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bd063246-9685-4f72-93a0-f7d9c044b5c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:22.043527 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bd063246-9685-4f72-93a0-f7d9c044b5c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:22.051891 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd063246-9685-4f72-93a0-f7d9c044b5c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:22.052484 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd063246-9685-4f72-93a0-f7d9c044b5c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:22.053483 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd063246-9685-4f72-93a0-f7d9c044b5c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:22.054303 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd063246-9685-4f72-93a0-f7d9c044b5c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:22.120683 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bd063246-9685-4f72-93a0-f7d9c044b5c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:22.129988 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bd063246-9685-4f72-93a0-f7d9c044b5c3 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.091372 Dec 15 14:26:22.130767 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1100/2122] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:22 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:22.481124 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6aaa77ff-3173-4b4c-9ab7-59a40b8d987d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:22.481773 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6aaa77ff-3173-4b4c-9ab7-59a40b8d987d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:22.489973 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6aaa77ff-3173-4b4c-9ab7-59a40b8d987d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:22.490423 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6aaa77ff-3173-4b4c-9ab7-59a40b8d987d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:22.491227 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6aaa77ff-3173-4b4c-9ab7-59a40b8d987d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:22.491658 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6aaa77ff-3173-4b4c-9ab7-59a40b8d987d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:22.506695 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-6aaa77ff-3173-4b4c-9ab7-59a40b8d987d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] HTTP exception thrown: Instance f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 could not be found. Dec 15 14:26:22.507328 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6aaa77ff-3173-4b4c-9ab7-59a40b8d987d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Returning 404 to user: Instance f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:26:22.508166 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6aaa77ff-3173-4b4c-9ab7-59a40b8d987d tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9" status: 404 len: 111 microversion: 2.1 time: 0.030959 Dec 15 14:26:22.508796 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1023/2123] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:22 2021] GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:26:22.519562 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5e4f35b6-830e-47a9-93a5-a51ba7a9e0af tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '.version_select at 0x7faa3c82b1f0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:22.547424 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5e4f35b6-830e-47a9-93a5-a51ba7a9e0af tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1533284212" status: 202 len: 0 microversion: 2.1 time: 0.033492 Dec 15 14:26:22.548010 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1101/2124] 10.222.0.42 () {58 vars in 1220 bytes} [Wed Dec 15 14:26:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1533284212 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:26:23.155089 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c3755162-e564-4b16-868b-5df5e249dce1 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:23.155716 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c3755162-e564-4b16-868b-5df5e249dce1 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:23.162350 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3755162-e564-4b16-868b-5df5e249dce1 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:23.162799 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3755162-e564-4b16-868b-5df5e249dce1 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:23.164679 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3755162-e564-4b16-868b-5df5e249dce1 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:23.164679 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3755162-e564-4b16-868b-5df5e249dce1 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:23.233098 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c3755162-e564-4b16-868b-5df5e249dce1 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:23.243631 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c3755162-e564-4b16-868b-5df5e249dce1 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.092689 Dec 15 14:26:23.244235 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1024/2125] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:23 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:24.261878 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b7eeb19a-389e-45c4-a829-258274e9161f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:24.262535 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b7eeb19a-389e-45c4-a829-258274e9161f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:24.269550 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b7eeb19a-389e-45c4-a829-258274e9161f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:24.270034 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b7eeb19a-389e-45c4-a829-258274e9161f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:24.270832 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b7eeb19a-389e-45c4-a829-258274e9161f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:24.271271 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b7eeb19a-389e-45c4-a829-258274e9161f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:24.338056 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b7eeb19a-389e-45c4-a829-258274e9161f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:24.347080 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b7eeb19a-389e-45c4-a829-258274e9161f tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.089425 Dec 15 14:26:24.347682 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1102/2126] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:24 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:25.364866 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d0543121-ecce-4289-a919-36aee6688e20 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:25.365510 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d0543121-ecce-4289-a919-36aee6688e20 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:25.372463 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0543121-ecce-4289-a919-36aee6688e20 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:25.372908 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0543121-ecce-4289-a919-36aee6688e20 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:25.373739 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0543121-ecce-4289-a919-36aee6688e20 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:25.374155 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0543121-ecce-4289-a919-36aee6688e20 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:25.437826 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d0543121-ecce-4289-a919-36aee6688e20 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:25.446429 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d0543121-ecce-4289-a919-36aee6688e20 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.085480 Dec 15 14:26:25.446985 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1025/2127] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:25 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:26.464029 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-137ae49f-dd6d-4256-ae99-659f3a990c97 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:26.464797 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-137ae49f-dd6d-4256-ae99-659f3a990c97 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] [instance: 95358386-841b-4e1b-9d6b-8fdc3751799f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:26.471975 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-137ae49f-dd6d-4256-ae99-659f3a990c97 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:26.472432 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-137ae49f-dd6d-4256-ae99-659f3a990c97 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:26.473234 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-137ae49f-dd6d-4256-ae99-659f3a990c97 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:26.473703 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-137ae49f-dd6d-4256-ae99-659f3a990c97 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:26.541359 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-137ae49f-dd6d-4256-ae99-659f3a990c97 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b87ff00a9da48e5aa3636790bce3772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaf014646924970b2c59d6a4b7d7274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:26.551701 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-137ae49f-dd6d-4256-ae99-659f3a990c97 tempest-VolumesSnapshotTestJSON-1612498958 tempest-VolumesSnapshotTestJSON-1612498958-project] 10.222.0.42 "GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f" status: 200 len: 1349 microversion: 2.1 time: 0.091505 Dec 15 14:26:26.552285 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1103/2128] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:26 2021] GET /compute/v2.1/servers/95358386-841b-4e1b-9d6b-8fdc3751799f => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:51.099680 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:26:51.100374 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:26:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:28:19.074726 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-08b6966a-92c6-4815-805b-99f8797474ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:28:19.075580 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-08b6966a-92c6-4815-805b-99f8797474ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:28:19.081956 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-08b6966a-92c6-4815-805b-99f8797474ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:19.082413 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-08b6966a-92c6-4815-805b-99f8797474ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:19.083218 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-08b6966a-92c6-4815-805b-99f8797474ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:19.083661 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-08b6966a-92c6-4815-805b-99f8797474ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:19.110607 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-08b6966a-92c6-4815-805b-99f8797474ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:28:19.215097 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-08b6966a-92c6-4815-805b-99f8797474ba tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b" status: 204 len: 0 microversion: 2.20 time: 0.145663 Dec 15 14:28:19.219040 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1026/2129] 10.222.0.42 () {60 vars in 1279 bytes} [Wed Dec 15 14:28:19 2021] DELETE /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 14:28:19.224508 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: ERROR oslo.messaging._drivers.impl_rabbit [-] [95a38445-d847-45c9-bd16-30efac0beb8d] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 15 14:28:19.229979 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7e9abab1-dc4c-4090-99eb-9d1f752567ff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:28:19.230877 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7e9abab1-dc4c-4090-99eb-9d1f752567ff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:28:19.238253 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e9abab1-dc4c-4090-99eb-9d1f752567ff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:19.238733 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e9abab1-dc4c-4090-99eb-9d1f752567ff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:19.239537 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e9abab1-dc4c-4090-99eb-9d1f752567ff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:19.239980 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e9abab1-dc4c-4090-99eb-9d1f752567ff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:19.423972 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7e9abab1-dc4c-4090-99eb-9d1f752567ff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:28:19.436909 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7e9abab1-dc4c-4090-99eb-9d1f752567ff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:28:19.438708 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7e9abab1-dc4c-4090-99eb-9d1f752567ff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:28:19.440804 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7e9abab1-dc4c-4090-99eb-9d1f752567ff tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b" status: 200 len: 1724 microversion: 2.20 time: 0.218687 Dec 15 14:28:19.441430 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1104/2130] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:28:19 2021] GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:28:20.464332 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e8e15b78-e119-4bbb-893f-dbb0c3088460 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:28:20.465037 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e8e15b78-e119-4bbb-893f-dbb0c3088460 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:28:20.480616 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8e15b78-e119-4bbb-893f-dbb0c3088460 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:20.481094 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8e15b78-e119-4bbb-893f-dbb0c3088460 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:20.481956 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8e15b78-e119-4bbb-893f-dbb0c3088460 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:20.482396 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8e15b78-e119-4bbb-893f-dbb0c3088460 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:20.848012 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e8e15b78-e119-4bbb-893f-dbb0c3088460 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:28:20.857931 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e8e15b78-e119-4bbb-893f-dbb0c3088460 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:28:20.859527 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e8e15b78-e119-4bbb-893f-dbb0c3088460 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39f58b934374c718793574870072027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5979590d3d84996a1c7bd99feffc601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:28:20.860713 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e8e15b78-e119-4bbb-893f-dbb0c3088460 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b" status: 200 len: 1724 microversion: 2.20 time: 0.401113 Dec 15 14:28:20.861279 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1027/2131] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:28:20 2021] GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b => generated 1724 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:28:21.151110 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] [95a38445-d847-45c9-bd16-30efac0beb8d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 52838. Dec 15 14:28:21.236263 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-5b0f886c-2d75-4a58-b02d-4b2e6310d33a req-c624f03e-f176-4c7a-bc72-b62c5c7a6769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52081f6-a4da-417f-8092-e26d5315a39b", "name": "network-vif-deleted", "tag": "3be25b39-2c2c-49c8-8aae-df0e43911b97"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:28:21.238156 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:28:21.238156 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:28:21.246777 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-5b0f886c-2d75-4a58-b02d-4b2e6310d33a req-c624f03e-f176-4c7a-bc72-b62c5c7a6769 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:21.247201 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-5b0f886c-2d75-4a58-b02d-4b2e6310d33a req-c624f03e-f176-4c7a-bc72-b62c5c7a6769 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:21.259887 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-5b0f886c-2d75-4a58-b02d-4b2e6310d33a req-c624f03e-f176-4c7a-bc72-b62c5c7a6769 service nova] Creating event network-vif-deleted:3be25b39-2c2c-49c8-8aae-df0e43911b97 for instance a52081f6-a4da-417f-8092-e26d5315a39b on hv-cinder-82182 Dec 15 14:28:21.266531 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-5b0f886c-2d75-4a58-b02d-4b2e6310d33a req-c624f03e-f176-4c7a-bc72-b62c5c7a6769 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159821 Dec 15 14:28:21.267905 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1105/2132] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:28:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:28:21.879622 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0c495225-89ea-4a37-9670-393c8fdd7a42 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:28:21.880347 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0c495225-89ea-4a37-9670-393c8fdd7a42 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:28:21.887144 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0c495225-89ea-4a37-9670-393c8fdd7a42 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:21.887692 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0c495225-89ea-4a37-9670-393c8fdd7a42 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:21.888549 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0c495225-89ea-4a37-9670-393c8fdd7a42 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:21.889054 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0c495225-89ea-4a37-9670-393c8fdd7a42 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:21.902977 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-0c495225-89ea-4a37-9670-393c8fdd7a42 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] HTTP exception thrown: Instance a52081f6-a4da-417f-8092-e26d5315a39b could not be found. Dec 15 14:28:21.903604 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0c495225-89ea-4a37-9670-393c8fdd7a42 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Returning 404 to user: Instance a52081f6-a4da-417f-8092-e26d5315a39b could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:28:21.904531 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0c495225-89ea-4a37-9670-393c8fdd7a42 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b" status: 404 len: 111 microversion: 2.20 time: 0.028622 Dec 15 14:28:21.904995 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1028/2133] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:28:21 2021] GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 14:28:21.913997 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c2aeda3b-e09d-4be7-9319-84319009403c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '.version_select at 0x7faa414a01f0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:28:21.934256 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c2aeda3b-e09d-4be7-9319-84319009403c tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1975655170" status: 204 len: 0 microversion: 2.20 time: 0.024455 Dec 15 14:28:21.935033 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1106/2134] 10.222.0.42 () {60 vars in 1261 bytes} [Wed Dec 15 14:28:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1975655170 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 14:28:22.878196 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:28:22.878945 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:28:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:30:09.526946 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:30:09.527937 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:30:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:30:11.119761 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:30:11.120407 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:30:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:30:31.418421 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:30:31.418421 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:30:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:30:34.784843 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:30:34.785400 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:30:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:31:42.896666 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:31:42.897450 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:31:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:32:28.591437 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41f2c873-fa48-4b32-a1ab-8c665c803ff6] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 15 14:32:28.594918 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-34e187b1-e63a-40d6-8b4f-f40ceaf5c742 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:32:28.595432 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-34e187b1-e63a-40d6-8b4f-f40ceaf5c742 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:32:28.602705 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34e187b1-e63a-40d6-8b4f-f40ceaf5c742 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:32:28.603163 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34e187b1-e63a-40d6-8b4f-f40ceaf5c742 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:32:28.603988 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34e187b1-e63a-40d6-8b4f-f40ceaf5c742 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:32:28.604427 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34e187b1-e63a-40d6-8b4f-f40ceaf5c742 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:32:28.618765 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-34e187b1-e63a-40d6-8b4f-f40ceaf5c742 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] HTTP exception thrown: Instance f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 could not be found. Dec 15 14:32:28.619429 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-34e187b1-e63a-40d6-8b4f-f40ceaf5c742 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Returning 404 to user: Instance f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:32:28.620294 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-34e187b1-e63a-40d6-8b4f-f40ceaf5c742 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9" status: 404 len: 111 microversion: 2.1 time: 0.031155 Dec 15 14:32:28.621122 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1029/2135] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:32:28 2021] DELETE /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:32:28.627894 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: ERROR oslo.messaging._drivers.impl_rabbit [-] [95a38445-d847-45c9-bd16-30efac0beb8d] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 14:32:28.631657 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3babe7ce-18df-47df-a796-69527336cb86 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:32:28.632407 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3babe7ce-18df-47df-a796-69527336cb86 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:32:28.639106 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3babe7ce-18df-47df-a796-69527336cb86 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:32:28.639519 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3babe7ce-18df-47df-a796-69527336cb86 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:32:28.640315 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3babe7ce-18df-47df-a796-69527336cb86 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:32:28.640753 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3babe7ce-18df-47df-a796-69527336cb86 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:32:28.654631 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-3babe7ce-18df-47df-a796-69527336cb86 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] HTTP exception thrown: Instance f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 could not be found. Dec 15 14:32:28.655251 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3babe7ce-18df-47df-a796-69527336cb86 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Returning 404 to user: Instance f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:32:28.656093 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3babe7ce-18df-47df-a796-69527336cb86 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9" status: 404 len: 111 microversion: 2.1 time: 0.030453 Dec 15 14:32:28.656627 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1107/2136] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:32:28 2021] GET /compute/v2.1/servers/f8e36deb-6fd9-4f0c-ba78-6d8eb888bee9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:33:29.104126 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:33:29.105441 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:33:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:33:29.545531 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:33:29.546170 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:33:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:33:31.138806 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:33:31.139801 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:33:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:33:51.439737 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:33:51.440428 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:33:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:33:54.804023 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:33:54.804818 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:33:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:34:22.091921 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e4aabbe1-5f78-4058-8fc9-766743371e55 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:34:22.092588 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e4aabbe1-5f78-4058-8fc9-766743371e55 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:34:22.102387 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4aabbe1-5f78-4058-8fc9-766743371e55 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:34:22.102970 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4aabbe1-5f78-4058-8fc9-766743371e55 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:34:22.104130 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4aabbe1-5f78-4058-8fc9-766743371e55 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:34:22.104706 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4aabbe1-5f78-4058-8fc9-766743371e55 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:34:22.110044 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] [41f2c873-fa48-4b32-a1ab-8c665c803ff6] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 55010. Dec 15 14:34:22.127919 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-e4aabbe1-5f78-4058-8fc9-766743371e55 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] HTTP exception thrown: Instance a52081f6-a4da-417f-8092-e26d5315a39b could not be found. Dec 15 14:34:22.128494 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e4aabbe1-5f78-4058-8fc9-766743371e55 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Returning 404 to user: Instance a52081f6-a4da-417f-8092-e26d5315a39b could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:34:22.129312 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e4aabbe1-5f78-4058-8fc9-766743371e55 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b" status: 404 len: 111 microversion: 2.20 time: 0.060604 Dec 15 14:34:22.129877 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1030/2137] 10.222.0.42 () {60 vars in 1279 bytes} [Wed Dec 15 14:34:22 2021] DELETE /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 14:34:22.157690 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4a7917d4-b49e-447a-b857-552403b0f3c5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:34:22.158323 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4a7917d4-b49e-447a-b857-552403b0f3c5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: a52081f6-a4da-417f-8092-e26d5315a39b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:34:22.166004 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a7917d4-b49e-447a-b857-552403b0f3c5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:34:22.166458 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a7917d4-b49e-447a-b857-552403b0f3c5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:34:22.167241 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a7917d4-b49e-447a-b857-552403b0f3c5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:34:22.167678 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a7917d4-b49e-447a-b857-552403b0f3c5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:34:22.171145 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] [95a38445-d847-45c9-bd16-30efac0beb8d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 55016. Dec 15 14:34:22.182576 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-4a7917d4-b49e-447a-b857-552403b0f3c5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] HTTP exception thrown: Instance a52081f6-a4da-417f-8092-e26d5315a39b could not be found. Dec 15 14:34:22.183187 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4a7917d4-b49e-447a-b857-552403b0f3c5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Returning 404 to user: Instance a52081f6-a4da-417f-8092-e26d5315a39b could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:34:22.184034 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4a7917d4-b49e-447a-b857-552403b0f3c5 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b" status: 404 len: 111 microversion: 2.20 time: 0.047770 Dec 15 14:34:22.184622 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1108/2138] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:34:22 2021] GET /compute/v2.1/servers/a52081f6-a4da-417f-8092-e26d5315a39b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 14:35:02.914936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:35:02.915692 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:35:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:36:49.130257 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:36:49.130990 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:36:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:36:49.564556 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:36:49.564556 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:36:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:36:51.164247 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:36:51.164849 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:36:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:37:11.459170 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:37:11.459889 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:37:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:37:14.823247 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:37:14.823886 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:37:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:38:22.933771 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:38:22.934546 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:38:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:38:28.206170 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41f2c873-fa48-4b32-a1ab-8c665c803ff6] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 15 14:38:28.209640 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-054e9c78-daff-49d8-b2dc-957e9a675760 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:28.210207 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-054e9c78-daff-49d8-b2dc-957e9a675760 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:38:28.216808 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-054e9c78-daff-49d8-b2dc-957e9a675760 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:38:28.217258 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-054e9c78-daff-49d8-b2dc-957e9a675760 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:38:28.218057 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-054e9c78-daff-49d8-b2dc-957e9a675760 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:38:28.218520 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-054e9c78-daff-49d8-b2dc-957e9a675760 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:38:28.232354 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-054e9c78-daff-49d8-b2dc-957e9a675760 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] HTTP exception thrown: Instance 08832229-b545-4a06-a332-54ab9a72bacd could not be found. Dec 15 14:38:28.232946 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-054e9c78-daff-49d8-b2dc-957e9a675760 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Returning 404 to user: Instance 08832229-b545-4a06-a332-54ab9a72bacd could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:38:28.233826 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-054e9c78-daff-49d8-b2dc-957e9a675760 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "DELETE /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 404 len: 111 microversion: 2.1 time: 0.029892 Dec 15 14:38:28.234373 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1031/2139] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:38:28 2021] DELETE /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:38:28.241755 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: ERROR oslo.messaging._drivers.impl_rabbit [-] [95a38445-d847-45c9-bd16-30efac0beb8d] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 15 14:38:28.245367 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ad59442e-dad3-4c17-9d01-546dd35c9ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:28.245985 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ad59442e-dad3-4c17-9d01-546dd35c9ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] [instance: 08832229-b545-4a06-a332-54ab9a72bacd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:38:28.253392 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad59442e-dad3-4c17-9d01-546dd35c9ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:38:28.253861 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad59442e-dad3-4c17-9d01-546dd35c9ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:38:28.254714 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad59442e-dad3-4c17-9d01-546dd35c9ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:38:28.255142 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad59442e-dad3-4c17-9d01-546dd35c9ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:38:28.268709 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-ad59442e-dad3-4c17-9d01-546dd35c9ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] HTTP exception thrown: Instance 08832229-b545-4a06-a332-54ab9a72bacd could not be found. Dec 15 14:38:28.269288 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ad59442e-dad3-4c17-9d01-546dd35c9ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] Returning 404 to user: Instance 08832229-b545-4a06-a332-54ab9a72bacd could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:38:28.270160 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ad59442e-dad3-4c17-9d01-546dd35c9ef2 tempest-AttachVolumeTestJSON-1109162180 tempest-AttachVolumeTestJSON-1109162180-project] 10.222.0.42 "GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd" status: 404 len: 111 microversion: 2.1 time: 0.031272 Dec 15 14:38:28.270701 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1109/2140] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:38:28 2021] GET /compute/v2.1/servers/08832229-b545-4a06-a332-54ab9a72bacd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 14:38:33.329390 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] [41f2c873-fa48-4b32-a1ab-8c665c803ff6] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 56552. Dec 15 14:38:33.487309 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9112db94-9e82-4641-8304-b0ea806dc14d tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Action: 'create', calling method: .version_select at 0x7faa3c700b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1622058191", "metadata": {"Type": "work"}}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:38:33.918382 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9112db94-9e82-4641-8304-b0ea806dc14d tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.610478 Dec 15 14:38:33.919006 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1032/2141] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Dec 15 14:38:33 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 612 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 14:38:33.930489 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-75c2af20-b90a-49f9-a395-f8d641dc3007 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c8291f0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:33.958485 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] [95a38445-d847-45c9-bd16-30efac0beb8d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 56568. Dec 15 14:38:34.054070 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-75c2af20-b90a-49f9-a395-f8d641dc3007 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.127288 Dec 15 14:38:34.054709 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1110/2142] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:33 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:35.068030 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-60661782-c2e4-478e-bd6f-bd9d84605678 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c87f940>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:35.118562 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-60661782-c2e4-478e-bd6f-bd9d84605678 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.054952 Dec 15 14:38:35.119181 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1033/2143] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:35 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:36.134281 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8e3f6a94-95e9-4a64-ab42-5d393c3b1610 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa414db550>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:36.182498 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8e3f6a94-95e9-4a64-ab42-5d393c3b1610 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.052617 Dec 15 14:38:36.183077 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1111/2144] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:36 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:37.197910 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0af7740d-df2b-4fc8-ada5-05f4ce5539cd tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c972040>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:37.245680 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0af7740d-df2b-4fc8-ada5-05f4ce5539cd tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.052280 Dec 15 14:38:37.246399 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1034/2145] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:37 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:38.262285 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d37a3d85-d583-4ed7-ae00-4c56285f4b34 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c829700>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:38.316981 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d37a3d85-d583-4ed7-ae00-4c56285f4b34 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.061442 Dec 15 14:38:38.317769 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1112/2146] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:38 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:39.333156 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9f92b4f5-1f1b-4af4-b948-ef69d953f8dc tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c772af0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:39.393190 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9f92b4f5-1f1b-4af4-b948-ef69d953f8dc tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.064919 Dec 15 14:38:39.393800 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1035/2147] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:39 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:40.409044 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9f79d35b-bf67-46a2-bcb2-78dc50c40856 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa4153eaf0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:40.463663 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9f79d35b-bf67-46a2-bcb2-78dc50c40856 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.060099 Dec 15 14:38:40.464232 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1113/2148] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:40 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:41.479595 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f5bc84c9-6f30-4f4e-8414-4b1272309ed5 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c8f8700>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:41.532513 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f5bc84c9-6f30-4f4e-8414-4b1272309ed5 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.058869 Dec 15 14:38:41.533474 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1036/2149] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:41 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:42.547877 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f4ec695c-72ee-42a3-bc9a-2b88a60ad791 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c808a60>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:42.597376 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f4ec695c-72ee-42a3-bc9a-2b88a60ad791 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.054207 Dec 15 14:38:42.597986 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1114/2150] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:42 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:43.611444 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6f11eabe-1a78-4cd0-8a30-f37e916db0e1 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c894940>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:43.665851 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6f11eabe-1a78-4cd0-8a30-f37e916db0e1 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.059804 Dec 15 14:38:43.666434 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1037/2151] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:43 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:44.683810 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e95038df-9bdc-4807-b475-deac7c1e3991 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa4153eb80>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:44.736444 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e95038df-9bdc-4807-b475-deac7c1e3991 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.059363 Dec 15 14:38:44.737023 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1115/2152] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:44 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:45.750426 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a7f00864-d533-4139-aecc-1cace6685a6e tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c700e50>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:45.799254 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a7f00864-d533-4139-aecc-1cace6685a6e tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.053292 Dec 15 14:38:45.799838 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1038/2153] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:45 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:46.812807 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-120e1b95-39c2-47a5-b393-dadc33f2d952 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c859dc0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:46.866751 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-120e1b95-39c2-47a5-b393-dadc33f2d952 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.058031 Dec 15 14:38:46.867552 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1116/2154] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:46 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:47.883444 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9f22f99e-bd6d-48d4-8ee8-1d4d11ae50c5 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c7b8dc0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:47.934612 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9f22f99e-bd6d-48d4-8ee8-1d4d11ae50c5 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.056504 Dec 15 14:38:47.935181 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1039/2155] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:47 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:38:48.954499 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1664bb8b-39cb-479d-9569-80b8dfdcc5d7 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c830ca0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:49.006446 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1664bb8b-39cb-479d-9569-80b8dfdcc5d7 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.059042 Dec 15 14:38:49.006997 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1117/2156] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:48 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:50.020009 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-84cc486e-cc24-4295-b53c-de5f0247fd04 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c87f280>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:50.068873 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-84cc486e-cc24-4295-b53c-de5f0247fd04 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.053024 Dec 15 14:38:50.069507 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1040/2157] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:50 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:51.083012 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4a6af3fc-0677-4fb4-9ed8-38c8236e8e38 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c829a60>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:51.133815 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4a6af3fc-0677-4fb4-9ed8-38c8236e8e38 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.054930 Dec 15 14:38:51.134406 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1118/2158] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:51 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:52.147365 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d6a731de-ff81-436c-b4a0-48dd56d423e2 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c772f70>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:52.195144 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d6a731de-ff81-436c-b4a0-48dd56d423e2 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.051852 Dec 15 14:38:52.195748 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1041/2159] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:52 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:53.208521 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-544f15ea-7485-4831-8984-347195c10826 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa4153eaf0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:53.261640 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-544f15ea-7485-4831-8984-347195c10826 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.057157 Dec 15 14:38:53.262218 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1119/2160] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:53 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:54.277008 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-08a9fc1f-44c2-498d-820a-02a7e90c00ab tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c6bcd30>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:54.325980 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-08a9fc1f-44c2-498d-820a-02a7e90c00ab tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.054231 Dec 15 14:38:54.326550 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1042/2161] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:54 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:55.344488 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4e728fe6-7f8e-4a3f-8cc6-f08c628047da tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c933310>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:55.394729 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4e728fe6-7f8e-4a3f-8cc6-f08c628047da tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.059527 Dec 15 14:38:55.395337 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1120/2162] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:55 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:56.412473 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0a51ebc5-f930-47c7-84b8-0cdd990f78aa tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c7724c0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:56.468597 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0a51ebc5-f930-47c7-84b8-0cdd990f78aa tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.063002 Dec 15 14:38:56.469173 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1043/2163] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:56 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:57.482033 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6a6a5549-8cc6-412e-9384-cc79c0d8070f tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c808dc0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:57.530718 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6a6a5549-8cc6-412e-9384-cc79c0d8070f tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.052991 Dec 15 14:38:57.531491 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1121/2164] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:57 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:58.547899 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a973cd37-d68e-49c5-ac78-51188af408c3 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c87f280>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:58.595739 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a973cd37-d68e-49c5-ac78-51188af408c3 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.052493 Dec 15 14:38:58.596293 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1044/2165] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:58 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:38:59.610613 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a8918964-8a34-44a5-96d8-af63eca4847d tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa414fec10>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:38:59.659596 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a8918964-8a34-44a5-96d8-af63eca4847d tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.053301 Dec 15 14:38:59.660148 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1122/2166] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:38:59 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:00.675131 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0a92c1ea-7ce1-4b24-b805-d1806ed46c0e tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c6bcf70>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:00.724361 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0a92c1ea-7ce1-4b24-b805-d1806ed46c0e tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.054182 Dec 15 14:39:00.724923 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1045/2167] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:00 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:01.737462 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fdb99562-34a4-49b1-8390-459ad3448181 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa414dcb80>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:01.790136 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fdb99562-34a4-49b1-8390-459ad3448181 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.056509 Dec 15 14:39:01.790721 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1123/2168] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:01 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:02.803414 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-79d0b880-b63b-4acf-9044-238ce92560de tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c6bce50>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:02.856652 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-79d0b880-b63b-4acf-9044-238ce92560de tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.057324 Dec 15 14:39:02.857239 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1046/2169] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:02 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:03.873435 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7471932a-11e3-408b-99b9-8abeb34824b3 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c9b24c0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:03.919769 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7471932a-11e3-408b-99b9-8abeb34824b3 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.051407 Dec 15 14:39:03.920346 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1124/2170] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:03 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:04.939497 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d860bef4-12be-4eba-b6ba-aa4ac6980d68 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c700940>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:04.992087 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d860bef4-12be-4eba-b6ba-aa4ac6980d68 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.060199 Dec 15 14:39:04.992663 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1047/2171] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:04 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:06.005835 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-07e5ab00-0710-4a6c-ba1c-158895932422 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c808d30>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:06.058345 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-07e5ab00-0710-4a6c-ba1c-158895932422 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.056917 Dec 15 14:39:06.058916 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1125/2172] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:06 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:07.071632 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d3fb75f9-ff3e-4d76-82bf-1cb345c99696 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c7249d0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:07.120245 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d3fb75f9-ff3e-4d76-82bf-1cb345c99696 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.053094 Dec 15 14:39:07.120818 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1048/2173] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:07 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:08.137831 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b3a23429-d2be-487e-a8f3-780250cd8579 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c829af0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:08.194952 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b3a23429-d2be-487e-a8f3-780250cd8579 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.063867 Dec 15 14:39:08.195523 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1126/2174] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:08 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:09.210797 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a62f6e59-c47c-4408-9d90-b7dc94bfdde1 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c772f70>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:09.269650 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a62f6e59-c47c-4408-9d90-b7dc94bfdde1 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.064304 Dec 15 14:39:09.270286 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1049/2175] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:09 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:10.284017 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3a6d13f9-d69d-49f2-a714-82062722ad29 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c808dc0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:10.339050 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3a6d13f9-d69d-49f2-a714-82062722ad29 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.059739 Dec 15 14:39:10.339747 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1127/2176] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:10 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:11.356889 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-07d7c3f7-605e-485f-9795-415e885420d9 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c700f70>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:11.412384 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-07d7c3f7-605e-485f-9795-415e885420d9 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.062304 Dec 15 14:39:11.412948 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1050/2177] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:11 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:12.429308 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-07ec0275-c08f-4c61-9368-e58ab26df6ff tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c8594c0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:12.484105 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-07ec0275-c08f-4c61-9368-e58ab26df6ff tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.060606 Dec 15 14:39:12.484925 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1128/2178] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:12 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:13.500910 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fcf16d37-7077-4094-b52d-eb93cce10ad8 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c6bce50>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:13.558528 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fcf16d37-7077-4094-b52d-eb93cce10ad8 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.063685 Dec 15 14:39:13.559115 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1051/2179] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:13 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:14.574046 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c29b0034-5a68-4b95-b9b8-eb2afedffc84 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c8298b0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:14.633321 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c29b0034-5a68-4b95-b9b8-eb2afedffc84 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.064368 Dec 15 14:39:14.634223 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1129/2180] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:14 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:15.648839 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c0427bb9-21ea-45b9-88cf-74289f84405b tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c7005e0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:15.696895 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c0427bb9-21ea-45b9-88cf-74289f84405b tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.052178 Dec 15 14:39:15.697536 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1052/2181] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:15 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:16.713299 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7ece8cc8-db24-4542-b75f-4cafb489813f tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa414db040>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:16.772401 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7ece8cc8-db24-4542-b75f-4cafb489813f tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.065824 Dec 15 14:39:16.774398 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1130/2182] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:16 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:17.790126 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0b190814-ed31-4a03-ae00-7cfb973c611a tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c772f70>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:17.841084 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0b190814-ed31-4a03-ae00-7cfb973c611a tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.057220 Dec 15 14:39:17.841771 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1053/2183] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:17 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:18.858132 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e43168dd-6cb1-42b7-983a-2e11d0d04149 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c9b2d30>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:18.914372 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e43168dd-6cb1-42b7-983a-2e11d0d04149 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.063836 Dec 15 14:39:18.915291 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1131/2184] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:18 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:19.931048 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2a29d1ab-499c-4506-89d2-8434d6994dbf tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c6e5940>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:19.993200 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2a29d1ab-499c-4506-89d2-8434d6994dbf tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.067110 Dec 15 14:39:19.993790 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1054/2185] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:19 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:21.008320 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-19bc7793-ae5e-4ac8-a193-87ebda7a03d1 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c8089d0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:21.066116 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-19bc7793-ae5e-4ac8-a193-87ebda7a03d1 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.063689 Dec 15 14:39:21.067243 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1132/2186] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:21 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:22.084228 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9b511a47-8e89-439c-bf89-81f59da374c5 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c724e50>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:22.135489 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9b511a47-8e89-439c-bf89-81f59da374c5 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.057059 Dec 15 14:39:22.136101 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1055/2187] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:22 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:23.152703 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-528cfbc3-f093-496f-ac47-1707ca434baf tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c814700>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:23.213972 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-528cfbc3-f093-496f-ac47-1707ca434baf tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.068003 Dec 15 14:39:23.214838 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1133/2188] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:23 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:24.232131 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-06c8b929-f50a-40ad-b9d9-27fca2fcbb5e tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c700280>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:24.286137 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-06c8b929-f50a-40ad-b9d9-27fca2fcbb5e tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.059808 Dec 15 14:39:24.286683 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1056/2189] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:24 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:25.298914 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c4a68230-f629-4a24-a504-8a1f9166bb8e tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c859dc0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:25.349494 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c4a68230-f629-4a24-a504-8a1f9166bb8e tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.054478 Dec 15 14:39:25.350329 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1134/2190] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:25 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:26.363777 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0eca93c8-9172-45f4-8820-5efd969c91f3 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c590820>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:26.425276 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0eca93c8-9172-45f4-8820-5efd969c91f3 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.065693 Dec 15 14:39:26.425873 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1057/2191] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:26 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:27.444115 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-db924af0-02fe-425a-837f-77c50dc7b9c1 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c8291f0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:27.494832 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-db924af0-02fe-425a-837f-77c50dc7b9c1 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.056703 Dec 15 14:39:27.495410 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1135/2192] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:27 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:28.513551 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-14373dfd-700d-4cde-9c0e-71af1b4abe1a tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c86a310>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:28.571027 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-14373dfd-700d-4cde-9c0e-71af1b4abe1a tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 354 microversion: 2.1 time: 0.064037 Dec 15 14:39:28.571855 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1058/2193] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:28 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:28.587614 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1ec7d4e3-36d6-4c78-b47f-8626b127e91b tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c859790>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:28.639483 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1ec7d4e3-36d6-4c78-b47f-8626b127e91b tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 354 microversion: 2.1 time: 0.057004 Dec 15 14:39:28.640058 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1136/2194] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:28 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:28.658817 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0c00ffe0-b8b0-435d-9255-9a5a8003ccb6 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c772f70>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:28.728945 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0c00ffe0-b8b0-435d-9255-9a5a8003ccb6 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 202 len: 0 microversion: 2.1 time: 0.074106 Dec 15 14:39:28.729737 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1059/2195] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Dec 15 14:39:28 2021] DELETE /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:39:28.738349 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ec59867b-2416-4d99-871c-1f0c86d8d74d tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c9b2c10>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:28.791134 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ec59867b-2416-4d99-871c-1f0c86d8d74d tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.056194 Dec 15 14:39:28.791965 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1137/2196] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:28 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:39:29.156117 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-679dcd6b-0b45-4153-abbc-fbb6eb7987cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:29.156789 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-679dcd6b-0b45-4153-abbc-fbb6eb7987cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:39:29.167211 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-679dcd6b-0b45-4153-abbc-fbb6eb7987cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:29.167830 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-679dcd6b-0b45-4153-abbc-fbb6eb7987cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:29.169331 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-679dcd6b-0b45-4153-abbc-fbb6eb7987cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:29.170001 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-679dcd6b-0b45-4153-abbc-fbb6eb7987cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:29.184720 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-679dcd6b-0b45-4153-abbc-fbb6eb7987cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] HTTP exception thrown: Instance fcc65306-f419-4eac-97a2-407c5d6744da could not be found. Dec 15 14:39:29.185307 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-679dcd6b-0b45-4153-abbc-fbb6eb7987cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Returning 404 to user: Instance fcc65306-f419-4eac-97a2-407c5d6744da could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:39:29.186345 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-679dcd6b-0b45-4153-abbc-fbb6eb7987cd tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 404 len: 111 microversion: 2.20 time: 0.036035 Dec 15 14:39:29.186810 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1060/2197] 10.222.0.42 () {60 vars in 1279 bytes} [Wed Dec 15 14:39:29 2021] DELETE /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 14:39:29.194917 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-51fe1e07-06b3-40a9-8748-5a1d901a95c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:29.195518 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-51fe1e07-06b3-40a9-8748-5a1d901a95c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] [instance: fcc65306-f419-4eac-97a2-407c5d6744da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:39:29.202573 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-51fe1e07-06b3-40a9-8748-5a1d901a95c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:29.203020 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-51fe1e07-06b3-40a9-8748-5a1d901a95c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:29.203790 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-51fe1e07-06b3-40a9-8748-5a1d901a95c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:29.204222 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-51fe1e07-06b3-40a9-8748-5a1d901a95c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:29.217824 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-51fe1e07-06b3-40a9-8748-5a1d901a95c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] HTTP exception thrown: Instance fcc65306-f419-4eac-97a2-407c5d6744da could not be found. Dec 15 14:39:29.218490 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-51fe1e07-06b3-40a9-8748-5a1d901a95c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] Returning 404 to user: Instance fcc65306-f419-4eac-97a2-407c5d6744da could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:39:29.219332 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-51fe1e07-06b3-40a9-8748-5a1d901a95c8 tempest-AttachVolumeShelveTestJSON-455179236 tempest-AttachVolumeShelveTestJSON-455179236-project] 10.222.0.42 "GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da" status: 404 len: 111 microversion: 2.20 time: 0.028244 Dec 15 14:39:29.219869 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1138/2198] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Dec 15 14:39:29 2021] GET /compute/v2.1/servers/fcc65306-f419-4eac-97a2-407c5d6744da => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 14:39:29.808175 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ff5c0e1d-4633-4b6e-8adc-0d6ce0ae84b9 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c700f70>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:29.864419 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ff5c0e1d-4633-4b6e-8adc-0d6ce0ae84b9 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.061292 Dec 15 14:39:29.865033 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1061/2199] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:29 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:30.876695 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2347d59c-7c94-4954-a98a-c0e0f8ed023b tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c8083a0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:30.937829 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2347d59c-7c94-4954-a98a-c0e0f8ed023b tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.064880 Dec 15 14:39:30.938760 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1139/2200] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:30 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:31.952231 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-901c46dc-f07b-40d8-9a21-45b938902f92 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c724790>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:32.013826 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-901c46dc-f07b-40d8-9a21-45b938902f92 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.065791 Dec 15 14:39:32.021769 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1062/2201] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:31 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:33.029596 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1474823c-8793-44e1-a46b-797419904e24 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c868550>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:33.088998 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1474823c-8793-44e1-a46b-797419904e24 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 200 len: 353 microversion: 2.1 time: 0.063831 Dec 15 14:39:33.093973 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1140/2202] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:33 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:34.103717 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-245a580a-4fe0-489f-8693-47d38ac0e639 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Calling method '.version_select at 0x7faa3c6e5a60>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:34.138839 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-245a580a-4fe0-489f-8693-47d38ac0e639 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] HTTP exception thrown: Volume 45524cf2-d4a2-4ba9-90d0-f96ead31060e could not be found. Dec 15 14:39:34.139466 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-245a580a-4fe0-489f-8693-47d38ac0e639 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] Returning 404 to user: Volume 45524cf2-d4a2-4ba9-90d0-f96ead31060e could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:39:34.140306 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-245a580a-4fe0-489f-8693-47d38ac0e639 tempest-VolumesGetTestJSON-1820515994 tempest-VolumesGetTestJSON-1820515994-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e" status: 404 len: 109 microversion: 2.1 time: 0.042190 Dec 15 14:39:34.144999 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1063/2203] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Dec 15 14:39:34 2021] GET /compute/v2.1/os-volumes/45524cf2-d4a2-4ba9-90d0-f96ead31060e => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:39:35.331971 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-72cc0c16-51b7-4cd3-bf54-bd718fbcb886 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-263763261", "imageRef": "9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7", "flavorRef": "452", "networks": [{"uuid": "06484be5-1b63-4adb-9a9d-8910b46dd895"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:39:35.387532 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-72cc0c16-51b7-4cd3-bf54-bd718fbcb886 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] validate_networks() for [('06484be5-1b63-4adb-9a9d-8910b46dd895', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:39:35.912866 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-72cc0c16-51b7-4cd3-bf54-bd718fbcb886 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:39:35.913531 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-72cc0c16-51b7-4cd3-bf54-bd718fbcb886 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:39:35.914210 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-72cc0c16-51b7-4cd3-bf54-bd718fbcb886 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:39:35.914691 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-72cc0c16-51b7-4cd3-bf54-bd718fbcb886 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:39:35.915186 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-72cc0c16-51b7-4cd3-bf54-bd718fbcb886 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:39:35.924928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-72cc0c16-51b7-4cd3-bf54-bd718fbcb886 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:35.925440 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-72cc0c16-51b7-4cd3-bf54-bd718fbcb886 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:35.926543 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-72cc0c16-51b7-4cd3-bf54-bd718fbcb886 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:35.926971 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-72cc0c16-51b7-4cd3-bf54-bd718fbcb886 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:35.945968 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-72cc0c16-51b7-4cd3-bf54-bd718fbcb886 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Getting quotas for project 225b5a61fee14f748a30f2030266c65c. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:39:35.950651 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-72cc0c16-51b7-4cd3-bf54-bd718fbcb886 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Getting quotas for user 4c7378b95dd546ef9572852a4139fb12 and project 225b5a61fee14f748a30f2030266c65c. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:39:35.963861 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-72cc0c16-51b7-4cd3-bf54-bd718fbcb886 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:39:35.966317 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-72cc0c16-51b7-4cd3-bf54-bd718fbcb886 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:39:36.018944 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-72cc0c16-51b7-4cd3-bf54-bd718fbcb886 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810590 Dec 15 14:39:36.019602 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1141/2204] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Dec 15 14:39:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:39:36.030062 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e4e2704a-96d9-4745-b681-e8895a02bad9 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:36.031182 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e4e2704a-96d9-4745-b681-e8895a02bad9 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:39:36.096475 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e4e2704a-96d9-4745-b681-e8895a02bad9 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:39:36.103511 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e4e2704a-96d9-4745-b681-e8895a02bad9 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c" status: 200 len: 1217 microversion: 2.1 time: 0.077684 Dec 15 14:39:36.104084 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1064/2205] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:39:36 2021] GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:39:37.121236 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6f1b3b0a-e348-46c3-a04c-1248adfb4e49 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:37.121897 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6f1b3b0a-e348-46c3-a04c-1248adfb4e49 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:39:37.129226 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f1b3b0a-e348-46c3-a04c-1248adfb4e49 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:37.129708 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f1b3b0a-e348-46c3-a04c-1248adfb4e49 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:37.130497 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f1b3b0a-e348-46c3-a04c-1248adfb4e49 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:37.130928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f1b3b0a-e348-46c3-a04c-1248adfb4e49 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:37.195943 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6f1b3b0a-e348-46c3-a04c-1248adfb4e49 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:39:37.204487 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6f1b3b0a-e348-46c3-a04c-1248adfb4e49 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c" status: 200 len: 1269 microversion: 2.1 time: 0.087367 Dec 15 14:39:37.205056 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1142/2206] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:39:37 2021] GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c => generated 1269 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:39:38.223459 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-29bdf738-c4d2-4856-938a-a003be66cc20 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:38.224605 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-29bdf738-c4d2-4856-938a-a003be66cc20 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:39:38.231733 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29bdf738-c4d2-4856-938a-a003be66cc20 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:38.232188 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29bdf738-c4d2-4856-938a-a003be66cc20 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:38.232971 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29bdf738-c4d2-4856-938a-a003be66cc20 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:38.233428 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29bdf738-c4d2-4856-938a-a003be66cc20 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:38.501996 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-29bdf738-c4d2-4856-938a-a003be66cc20 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:39:38.512746 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-29bdf738-c4d2-4856-938a-a003be66cc20 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c" status: 200 len: 1317 microversion: 2.1 time: 0.294421 Dec 15 14:39:38.513330 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1065/2207] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:39:38 2021] GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:39:39.045039 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-19f7255c-6432-451b-8142-574c05715258 req-870123da-4297-4f69-b2d6-45707dbe8f1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d171d12-9846-4408-8e30-94c02021b71c", "tag": "f76cd51a-cd97-48dc-b62c-2df3238be180"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:39:39.047481 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:39:39.047481 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:39:39.055917 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-19f7255c-6432-451b-8142-574c05715258 req-870123da-4297-4f69-b2d6-45707dbe8f1b service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:39.056613 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-19f7255c-6432-451b-8142-574c05715258 req-870123da-4297-4f69-b2d6-45707dbe8f1b service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:39.071576 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-19f7255c-6432-451b-8142-574c05715258 req-870123da-4297-4f69-b2d6-45707dbe8f1b service nova] Creating event network-changed:f76cd51a-cd97-48dc-b62c-2df3238be180 for instance 1d171d12-9846-4408-8e30-94c02021b71c on hv-cinder-82182 Dec 15 14:39:39.077703 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-19f7255c-6432-451b-8142-574c05715258 req-870123da-4297-4f69-b2d6-45707dbe8f1b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186534 Dec 15 14:39:39.078409 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1143/2208] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:39:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:39.531151 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8eedae96-661c-44a0-a5f3-e160142411df tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:39.531757 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8eedae96-661c-44a0-a5f3-e160142411df tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:39:39.538984 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8eedae96-661c-44a0-a5f3-e160142411df tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:39.539429 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8eedae96-661c-44a0-a5f3-e160142411df tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:39.540217 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8eedae96-661c-44a0-a5f3-e160142411df tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:39.540651 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8eedae96-661c-44a0-a5f3-e160142411df tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:39.818296 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8eedae96-661c-44a0-a5f3-e160142411df tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:39:39.826355 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8eedae96-661c-44a0-a5f3-e160142411df tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c" status: 200 len: 1317 microversion: 2.1 time: 0.299113 Dec 15 14:39:39.826920 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1066/2209] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:39:39 2021] GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:39:40.844706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d73c3a73-ae1a-4d3e-a33a-7fe864a31b36 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:40.845774 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d73c3a73-ae1a-4d3e-a33a-7fe864a31b36 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:39:40.852542 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d73c3a73-ae1a-4d3e-a33a-7fe864a31b36 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:40.852993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d73c3a73-ae1a-4d3e-a33a-7fe864a31b36 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:40.853811 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d73c3a73-ae1a-4d3e-a33a-7fe864a31b36 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:40.854254 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d73c3a73-ae1a-4d3e-a33a-7fe864a31b36 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:40.998178 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d73c3a73-ae1a-4d3e-a33a-7fe864a31b36 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:39:41.009877 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d73c3a73-ae1a-4d3e-a33a-7fe864a31b36 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c" status: 200 len: 1317 microversion: 2.1 time: 0.169713 Dec 15 14:39:41.010869 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1144/2210] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:39:40 2021] GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:39:42.029512 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a355cdfc-1172-4791-9b62-186b0ed6322b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:42.030195 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a355cdfc-1172-4791-9b62-186b0ed6322b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:39:42.037411 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a355cdfc-1172-4791-9b62-186b0ed6322b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:42.037898 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a355cdfc-1172-4791-9b62-186b0ed6322b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:42.038693 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a355cdfc-1172-4791-9b62-186b0ed6322b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:42.039263 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a355cdfc-1172-4791-9b62-186b0ed6322b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:42.187797 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a355cdfc-1172-4791-9b62-186b0ed6322b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:39:42.195643 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a355cdfc-1172-4791-9b62-186b0ed6322b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c" status: 200 len: 1317 microversion: 2.1 time: 0.169752 Dec 15 14:39:42.196267 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1067/2211] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:39:42 2021] GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:39:43.215859 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9e2105f6-5657-4edb-a3c9-b068565dfa2b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:43.216828 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9e2105f6-5657-4edb-a3c9-b068565dfa2b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:39:43.227172 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e2105f6-5657-4edb-a3c9-b068565dfa2b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:43.227880 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e2105f6-5657-4edb-a3c9-b068565dfa2b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:43.229096 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e2105f6-5657-4edb-a3c9-b068565dfa2b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:43.229828 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e2105f6-5657-4edb-a3c9-b068565dfa2b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:43.394023 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9e2105f6-5657-4edb-a3c9-b068565dfa2b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:39:43.402262 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9e2105f6-5657-4edb-a3c9-b068565dfa2b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c" status: 200 len: 1317 microversion: 2.1 time: 0.192290 Dec 15 14:39:43.402838 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1145/2212] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:39:43 2021] GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:39:44.420113 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8f237b14-6ed5-4db0-9b6d-99e28e82b47f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:44.420748 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8f237b14-6ed5-4db0-9b6d-99e28e82b47f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:39:44.430805 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f237b14-6ed5-4db0-9b6d-99e28e82b47f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:44.431311 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f237b14-6ed5-4db0-9b6d-99e28e82b47f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:44.432122 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f237b14-6ed5-4db0-9b6d-99e28e82b47f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:44.432563 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f237b14-6ed5-4db0-9b6d-99e28e82b47f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:44.588664 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8f237b14-6ed5-4db0-9b6d-99e28e82b47f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:39:44.596050 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8f237b14-6ed5-4db0-9b6d-99e28e82b47f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c" status: 200 len: 1317 microversion: 2.1 time: 0.180085 Dec 15 14:39:44.606204 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1068/2213] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:39:44 2021] GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:39:45.614476 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bc698e48-55e0-4ebb-b313-23d2fa48abbc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:45.615959 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bc698e48-55e0-4ebb-b313-23d2fa48abbc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:39:45.622904 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bc698e48-55e0-4ebb-b313-23d2fa48abbc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:45.623726 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bc698e48-55e0-4ebb-b313-23d2fa48abbc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:45.624605 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bc698e48-55e0-4ebb-b313-23d2fa48abbc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:45.625216 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bc698e48-55e0-4ebb-b313-23d2fa48abbc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:45.791607 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bc698e48-55e0-4ebb-b313-23d2fa48abbc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:39:45.800995 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bc698e48-55e0-4ebb-b313-23d2fa48abbc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c" status: 200 len: 1317 microversion: 2.1 time: 0.190261 Dec 15 14:39:45.801706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1146/2214] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:39:45 2021] GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:39:46.817682 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6e2bee1d-8ed7-47cb-b6ee-68ef80e84c3b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:46.819153 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6e2bee1d-8ed7-47cb-b6ee-68ef80e84c3b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:39:46.826105 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6e2bee1d-8ed7-47cb-b6ee-68ef80e84c3b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:46.826556 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6e2bee1d-8ed7-47cb-b6ee-68ef80e84c3b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:46.827377 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6e2bee1d-8ed7-47cb-b6ee-68ef80e84c3b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:46.827814 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6e2bee1d-8ed7-47cb-b6ee-68ef80e84c3b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:46.838567 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-903a8a76-8a17-4caf-b0b5-5efe0c16000d req-e5ffe17f-1f02-434b-ad02-be5f2e1689c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d171d12-9846-4408-8e30-94c02021b71c", "name": "network-vif-plugged", "status": "completed", "tag": "f76cd51a-cd97-48dc-b62c-2df3238be180"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:39:46.840167 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:39:46.840167 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:39:46.847170 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-903a8a76-8a17-4caf-b0b5-5efe0c16000d req-e5ffe17f-1f02-434b-ad02-be5f2e1689c6 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:46.847823 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-903a8a76-8a17-4caf-b0b5-5efe0c16000d req-e5ffe17f-1f02-434b-ad02-be5f2e1689c6 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:46.860775 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-903a8a76-8a17-4caf-b0b5-5efe0c16000d req-e5ffe17f-1f02-434b-ad02-be5f2e1689c6 service nova] Creating event network-vif-plugged:f76cd51a-cd97-48dc-b62c-2df3238be180 for instance 1d171d12-9846-4408-8e30-94c02021b71c on hv-cinder-82182 Dec 15 14:39:46.869661 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-903a8a76-8a17-4caf-b0b5-5efe0c16000d req-e5ffe17f-1f02-434b-ad02-be5f2e1689c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.279746 Dec 15 14:39:46.870754 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1069/2215] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:39:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:46.992084 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6e2bee1d-8ed7-47cb-b6ee-68ef80e84c3b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:39:47.000256 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6e2bee1d-8ed7-47cb-b6ee-68ef80e84c3b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c" status: 200 len: 1317 microversion: 2.1 time: 0.186226 Dec 15 14:39:47.003409 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1147/2216] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:39:46 2021] GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:39:48.021446 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b32329de-2bc4-4a13-bf49-7917c3f63697 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:48.022286 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b32329de-2bc4-4a13-bf49-7917c3f63697 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:39:48.029255 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b32329de-2bc4-4a13-bf49-7917c3f63697 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:48.029729 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b32329de-2bc4-4a13-bf49-7917c3f63697 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:48.030519 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b32329de-2bc4-4a13-bf49-7917c3f63697 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:48.031129 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b32329de-2bc4-4a13-bf49-7917c3f63697 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:48.192937 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b32329de-2bc4-4a13-bf49-7917c3f63697 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:39:48.203892 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b32329de-2bc4-4a13-bf49-7917c3f63697 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c" status: 200 len: 1317 microversion: 2.1 time: 0.188222 Dec 15 14:39:48.209496 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1070/2217] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:39:48 2021] GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:39:49.222461 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c2b15132-1220-42cb-b59a-7834b58eb54c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:39:49.223278 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c2b15132-1220-42cb-b59a-7834b58eb54c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:39:49.231524 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c2b15132-1220-42cb-b59a-7834b58eb54c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:49.232278 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c2b15132-1220-42cb-b59a-7834b58eb54c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:49.234233 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c2b15132-1220-42cb-b59a-7834b58eb54c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:49.234934 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c2b15132-1220-42cb-b59a-7834b58eb54c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:49.480657 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c2b15132-1220-42cb-b59a-7834b58eb54c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:39:49.492413 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c2b15132-1220-42cb-b59a-7834b58eb54c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c" status: 200 len: 1507 microversion: 2.1 time: 0.273573 Dec 15 14:39:49.493244 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1148/2218] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:39:49 2021] GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:39:51.003995 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4650bd3f-4539-4850-a1b1-e4cdbca65c96 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20a0323e-d20a-4697-aad4-05f3da070c93"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:39:51.005251 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4650bd3f-4539-4850-a1b1-e4cdbca65c96 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:39:51.012185 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4650bd3f-4539-4850-a1b1-e4cdbca65c96 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:51.012641 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4650bd3f-4539-4850-a1b1-e4cdbca65c96 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:51.013438 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4650bd3f-4539-4850-a1b1-e4cdbca65c96 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:51.013916 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4650bd3f-4539-4850-a1b1-e4cdbca65c96 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:51.329761 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4650bd3f-4539-4850-a1b1-e4cdbca65c96 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "POST /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330122 Dec 15 14:39:51.345264 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1071/2219] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Dec 15 14:39:50 2021] POST /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:39:58.162578 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6ee877a9-732c-45f7-bc5c-71d5a4fbc934 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Action: 'create', calling method: .version_select at 0x7faa3c808dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-567869390"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:39:58.180399 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-6ee877a9-732c-45f7-bc5c-71d5a4fbc934 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Getting quotas for project 8c64dae61ceb4d9280a759bf3f111c80. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:39:58.184850 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-6ee877a9-732c-45f7-bc5c-71d5a4fbc934 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Getting quotas for user 192b688b02c6455dbc4cdb22e7023521 and project 8c64dae61ceb4d9280a759bf3f111c80. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:39:58.196819 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6ee877a9-732c-45f7-bc5c-71d5a4fbc934 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [2ee9c50a-501a-4107-918a-30e73c25991d] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 14:39:59.158666 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-939b7543-a92a-427f-ad6a-85e9b365e52b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1305284520", "imageRef": "9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7", "flavorRef": "452", "networks": [{"uuid": "06484be5-1b63-4adb-9a9d-8910b46dd895"}]}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:39:59.218179 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-939b7543-a92a-427f-ad6a-85e9b365e52b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] validate_networks() for [('06484be5-1b63-4adb-9a9d-8910b46dd895', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:39:59.224209 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [None req-6ee877a9-732c-45f7-bc5c-71d5a4fbc934 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [2ee9c50a-501a-4107-918a-30e73c25991d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 57670. Dec 15 14:39:59.396626 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-6ee877a9-732c-45f7-bc5c-71d5a4fbc934 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Getting quotas for project 8c64dae61ceb4d9280a759bf3f111c80. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:39:59.401905 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-6ee877a9-732c-45f7-bc5c-71d5a4fbc934 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Getting quotas for user 192b688b02c6455dbc4cdb22e7023521 and project 8c64dae61ceb4d9280a759bf3f111c80. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:39:59.420954 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6ee877a9-732c-45f7-bc5c-71d5a4fbc934 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 1.463795 Dec 15 14:39:59.421561 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1149/2220] 10.222.0.42 () {60 vars in 1157 bytes} [Wed Dec 15 14:39:57 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:39:59.953795 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-939b7543-a92a-427f-ad6a-85e9b365e52b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:39:59.954623 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-939b7543-a92a-427f-ad6a-85e9b365e52b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:39:59.955810 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-939b7543-a92a-427f-ad6a-85e9b365e52b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:39:59.956940 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-939b7543-a92a-427f-ad6a-85e9b365e52b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:39:59.957921 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-939b7543-a92a-427f-ad6a-85e9b365e52b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:39:59.967920 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-939b7543-a92a-427f-ad6a-85e9b365e52b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:59.968644 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-939b7543-a92a-427f-ad6a-85e9b365e52b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:59.969677 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-939b7543-a92a-427f-ad6a-85e9b365e52b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:39:59.970124 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-939b7543-a92a-427f-ad6a-85e9b365e52b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:39:59.993886 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-939b7543-a92a-427f-ad6a-85e9b365e52b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Getting quotas for project 225b5a61fee14f748a30f2030266c65c. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:39:59.999456 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-939b7543-a92a-427f-ad6a-85e9b365e52b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Getting quotas for user 4c7378b95dd546ef9572852a4139fb12 and project 225b5a61fee14f748a30f2030266c65c. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:40:00.017345 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-939b7543-a92a-427f-ad6a-85e9b365e52b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:40:00.020553 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-939b7543-a92a-427f-ad6a-85e9b365e52b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:40:00.078198 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: ERROR oslo.messaging._drivers.impl_rabbit [None req-939b7543-a92a-427f-ad6a-85e9b365e52b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [5d8a92ce-79d9-47c5-bc76-fa0c36660ce9] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 14:40:01.098209 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [None req-939b7543-a92a-427f-ad6a-85e9b365e52b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [5d8a92ce-79d9-47c5-bc76-fa0c36660ce9] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 57760. Dec 15 14:40:01.105481 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-939b7543-a92a-427f-ad6a-85e9b365e52b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.950581 Dec 15 14:40:01.116636 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-573e5bd6-6388-4490-83c5-e21591d95f67 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:01.117360 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-573e5bd6-6388-4490-83c5-e21591d95f67 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:01.120721 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1072/2221] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Dec 15 14:39:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 1967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 14:40:01.189671 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-573e5bd6-6388-4490-83c5-e21591d95f67 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:01.197480 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-573e5bd6-6388-4490-83c5-e21591d95f67 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 200 len: 1218 microversion: 2.1 time: 0.084733 Dec 15 14:40:01.198390 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1150/2222] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:01 2021] GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:40:02.220126 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-498ef856-7a97-479d-9d84-4950a6d3bf6a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:02.221084 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-498ef856-7a97-479d-9d84-4950a6d3bf6a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:02.292702 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-498ef856-7a97-479d-9d84-4950a6d3bf6a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:02.300159 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-498ef856-7a97-479d-9d84-4950a6d3bf6a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 200 len: 1218 microversion: 2.1 time: 0.086830 Dec 15 14:40:02.303195 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1073/2223] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:02 2021] GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:03.320941 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4c1ce5b0-9100-477d-a9ff-5a7edc53b376 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:03.321449 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4c1ce5b0-9100-477d-a9ff-5a7edc53b376 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:03.397079 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4c1ce5b0-9100-477d-a9ff-5a7edc53b376 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:03.406960 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4c1ce5b0-9100-477d-a9ff-5a7edc53b376 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 200 len: 1218 microversion: 2.1 time: 0.090576 Dec 15 14:40:03.407845 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1151/2224] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:03 2021] GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:04.424622 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-870637a9-cad3-4dc2-9a50-34d42c0bf768 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:04.425329 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-870637a9-cad3-4dc2-9a50-34d42c0bf768 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:04.489724 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-870637a9-cad3-4dc2-9a50-34d42c0bf768 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:04.496721 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-870637a9-cad3-4dc2-9a50-34d42c0bf768 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 200 len: 1218 microversion: 2.1 time: 0.075778 Dec 15 14:40:04.497593 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1074/2225] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:04 2021] GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:05.513067 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8daedcd6-baac-49a7-8212-035a8ade6cca tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:05.514107 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8daedcd6-baac-49a7-8212-035a8ade6cca tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:05.521838 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8daedcd6-baac-49a7-8212-035a8ade6cca tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:05.525112 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8daedcd6-baac-49a7-8212-035a8ade6cca tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:05.526350 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8daedcd6-baac-49a7-8212-035a8ade6cca tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:05.526606 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8daedcd6-baac-49a7-8212-035a8ade6cca tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:05.595801 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8daedcd6-baac-49a7-8212-035a8ade6cca tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:05.604109 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8daedcd6-baac-49a7-8212-035a8ade6cca tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 200 len: 1222 microversion: 2.1 time: 0.094814 Dec 15 14:40:05.604704 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1152/2226] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:05 2021] GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:40:06.620651 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-02903e17-1c4f-4e38-8a08-962774f90c87 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:06.621433 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-02903e17-1c4f-4e38-8a08-962774f90c87 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:06.639436 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-02903e17-1c4f-4e38-8a08-962774f90c87 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:06.639946 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-02903e17-1c4f-4e38-8a08-962774f90c87 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:06.641120 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-02903e17-1c4f-4e38-8a08-962774f90c87 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:06.641565 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-02903e17-1c4f-4e38-8a08-962774f90c87 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:06.720771 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-02903e17-1c4f-4e38-8a08-962774f90c87 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:06.729148 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-02903e17-1c4f-4e38-8a08-962774f90c87 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 200 len: 1276 microversion: 2.1 time: 0.112522 Dec 15 14:40:06.729765 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1075/2227] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:06 2021] GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 1276 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:07.747213 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-064885d2-a1b2-4452-8ed4-23b70d6f303a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:07.747857 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-064885d2-a1b2-4452-8ed4-23b70d6f303a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:07.754993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-064885d2-a1b2-4452-8ed4-23b70d6f303a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:07.755447 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-064885d2-a1b2-4452-8ed4-23b70d6f303a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:07.756347 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-064885d2-a1b2-4452-8ed4-23b70d6f303a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:07.756782 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-064885d2-a1b2-4452-8ed4-23b70d6f303a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:07.998165 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-064885d2-a1b2-4452-8ed4-23b70d6f303a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:08.006614 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-064885d2-a1b2-4452-8ed4-23b70d6f303a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 200 len: 1318 microversion: 2.1 time: 0.263153 Dec 15 14:40:08.017853 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1153/2228] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:07 2021] GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:08.174467 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-6cffb65a-853a-436d-917f-7e04c6f727d0 req-e9e064d2-c936-4819-aeba-a339cac579fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f711acc5-e0cb-4209-83ee-e45d22132dd6", "tag": "e3bbe0c8-88e9-4081-9568-e5ae49af63c0"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:40:08.176087 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:40:08.176087 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:40:08.192931 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-6cffb65a-853a-436d-917f-7e04c6f727d0 req-e9e064d2-c936-4819-aeba-a339cac579fa service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:08.193490 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-6cffb65a-853a-436d-917f-7e04c6f727d0 req-e9e064d2-c936-4819-aeba-a339cac579fa service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:08.206172 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-6cffb65a-853a-436d-917f-7e04c6f727d0 req-e9e064d2-c936-4819-aeba-a339cac579fa service nova] Creating event network-changed:e3bbe0c8-88e9-4081-9568-e5ae49af63c0 for instance f711acc5-e0cb-4209-83ee-e45d22132dd6 on hv-cinder-82182 Dec 15 14:40:08.211591 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-6cffb65a-853a-436d-917f-7e04c6f727d0 req-e9e064d2-c936-4819-aeba-a339cac579fa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040699 Dec 15 14:40:08.212192 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1076/2229] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:40:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:40:09.027129 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8963c33a-7f65-462b-95ca-8f80f3f0ec8d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:09.027871 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8963c33a-7f65-462b-95ca-8f80f3f0ec8d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:09.034597 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8963c33a-7f65-462b-95ca-8f80f3f0ec8d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:09.035053 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8963c33a-7f65-462b-95ca-8f80f3f0ec8d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:09.035876 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8963c33a-7f65-462b-95ca-8f80f3f0ec8d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:09.036321 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8963c33a-7f65-462b-95ca-8f80f3f0ec8d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:09.307792 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8963c33a-7f65-462b-95ca-8f80f3f0ec8d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:09.315751 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8963c33a-7f65-462b-95ca-8f80f3f0ec8d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 200 len: 1318 microversion: 2.1 time: 0.292487 Dec 15 14:40:09.316256 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1154/2230] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:09 2021] GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:09.582718 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:40:09.583334 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:40:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:40:10.338385 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f8941ef1-e0cb-4178-a5b9-05e6ce91786a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:10.339163 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f8941ef1-e0cb-4178-a5b9-05e6ce91786a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:10.346050 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8941ef1-e0cb-4178-a5b9-05e6ce91786a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:10.346496 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8941ef1-e0cb-4178-a5b9-05e6ce91786a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:10.347286 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8941ef1-e0cb-4178-a5b9-05e6ce91786a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:10.347719 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8941ef1-e0cb-4178-a5b9-05e6ce91786a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:10.498950 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f8941ef1-e0cb-4178-a5b9-05e6ce91786a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:10.506782 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f8941ef1-e0cb-4178-a5b9-05e6ce91786a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 200 len: 1318 microversion: 2.1 time: 0.175944 Dec 15 14:40:10.507362 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1077/2231] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:10 2021] GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:11.524706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ce2d8d08-9c72-4548-8caa-325f3782bf5f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:11.525343 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ce2d8d08-9c72-4548-8caa-325f3782bf5f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:11.532370 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce2d8d08-9c72-4548-8caa-325f3782bf5f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:11.532816 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce2d8d08-9c72-4548-8caa-325f3782bf5f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:11.533593 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce2d8d08-9c72-4548-8caa-325f3782bf5f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:11.534050 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce2d8d08-9c72-4548-8caa-325f3782bf5f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:11.685721 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ce2d8d08-9c72-4548-8caa-325f3782bf5f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:11.693162 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ce2d8d08-9c72-4548-8caa-325f3782bf5f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 200 len: 1318 microversion: 2.1 time: 0.172181 Dec 15 14:40:11.693858 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1155/2232] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:11 2021] GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:12.712360 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2dc328de-92fb-4438-9ad8-cda3ca16f48a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:12.713078 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2dc328de-92fb-4438-9ad8-cda3ca16f48a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:12.721986 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2dc328de-92fb-4438-9ad8-cda3ca16f48a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:12.722652 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2dc328de-92fb-4438-9ad8-cda3ca16f48a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:12.723827 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2dc328de-92fb-4438-9ad8-cda3ca16f48a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:12.724452 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2dc328de-92fb-4438-9ad8-cda3ca16f48a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:12.877752 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2dc328de-92fb-4438-9ad8-cda3ca16f48a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:12.888626 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2dc328de-92fb-4438-9ad8-cda3ca16f48a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 200 len: 1318 microversion: 2.1 time: 0.180754 Dec 15 14:40:12.889268 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1078/2233] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:12 2021] GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:13.906001 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-87467a46-9dba-49ee-895a-98a5483598fa tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:13.906652 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-87467a46-9dba-49ee-895a-98a5483598fa tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:13.913534 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87467a46-9dba-49ee-895a-98a5483598fa tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:13.913945 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87467a46-9dba-49ee-895a-98a5483598fa tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:13.914718 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87467a46-9dba-49ee-895a-98a5483598fa tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:13.915142 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87467a46-9dba-49ee-895a-98a5483598fa tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:14.065922 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-87467a46-9dba-49ee-895a-98a5483598fa tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:14.076817 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-87467a46-9dba-49ee-895a-98a5483598fa tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 200 len: 1318 microversion: 2.1 time: 0.174762 Dec 15 14:40:14.077402 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1156/2234] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:13 2021] GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:15.100992 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-80bd2970-9a8d-4907-bee8-306fa29d3cbb tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:15.101924 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-80bd2970-9a8d-4907-bee8-306fa29d3cbb tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:15.110955 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80bd2970-9a8d-4907-bee8-306fa29d3cbb tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:15.111397 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80bd2970-9a8d-4907-bee8-306fa29d3cbb tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:15.112167 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80bd2970-9a8d-4907-bee8-306fa29d3cbb tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:15.112595 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80bd2970-9a8d-4907-bee8-306fa29d3cbb tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:15.265640 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-80bd2970-9a8d-4907-bee8-306fa29d3cbb tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:15.276346 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-80bd2970-9a8d-4907-bee8-306fa29d3cbb tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 200 len: 1318 microversion: 2.1 time: 0.181250 Dec 15 14:40:15.277143 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1079/2235] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:15 2021] GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:16.294718 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2e729575-d62b-4ccc-8205-c3c294ddcc15 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:16.295388 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2e729575-d62b-4ccc-8205-c3c294ddcc15 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:16.302098 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2e729575-d62b-4ccc-8205-c3c294ddcc15 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:16.302556 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2e729575-d62b-4ccc-8205-c3c294ddcc15 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:16.303343 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2e729575-d62b-4ccc-8205-c3c294ddcc15 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:16.303800 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2e729575-d62b-4ccc-8205-c3c294ddcc15 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:16.451544 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2e729575-d62b-4ccc-8205-c3c294ddcc15 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:16.459869 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2e729575-d62b-4ccc-8205-c3c294ddcc15 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 200 len: 1318 microversion: 2.1 time: 0.169216 Dec 15 14:40:16.460793 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1157/2236] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:16 2021] GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:16.764934 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-a855eaf6-48a3-457b-b728-77490f31ca2c req-4858b8cc-379e-4683-b535-074254a15b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f711acc5-e0cb-4209-83ee-e45d22132dd6", "name": "network-vif-plugged", "status": "completed", "tag": "e3bbe0c8-88e9-4081-9568-e5ae49af63c0"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:40:16.768163 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:40:16.768163 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:40:16.779064 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-a855eaf6-48a3-457b-b728-77490f31ca2c req-4858b8cc-379e-4683-b535-074254a15b91 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:16.780228 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-a855eaf6-48a3-457b-b728-77490f31ca2c req-4858b8cc-379e-4683-b535-074254a15b91 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:16.794699 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-a855eaf6-48a3-457b-b728-77490f31ca2c req-4858b8cc-379e-4683-b535-074254a15b91 service nova] Creating event network-vif-plugged:e3bbe0c8-88e9-4081-9568-e5ae49af63c0 for instance f711acc5-e0cb-4209-83ee-e45d22132dd6 on hv-cinder-82182 Dec 15 14:40:16.801522 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-a855eaf6-48a3-457b-b728-77490f31ca2c req-4858b8cc-379e-4683-b535-074254a15b91 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040701 Dec 15 14:40:16.802828 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1080/2237] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:40:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:40:17.480147 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-632afd52-657c-440a-ad2c-8b5b1d6d90c9 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:17.480904 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-632afd52-657c-440a-ad2c-8b5b1d6d90c9 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:17.487855 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-632afd52-657c-440a-ad2c-8b5b1d6d90c9 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:17.488312 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-632afd52-657c-440a-ad2c-8b5b1d6d90c9 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:17.489100 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-632afd52-657c-440a-ad2c-8b5b1d6d90c9 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:17.489529 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-632afd52-657c-440a-ad2c-8b5b1d6d90c9 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:17.632610 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-632afd52-657c-440a-ad2c-8b5b1d6d90c9 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:17.640097 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-632afd52-657c-440a-ad2c-8b5b1d6d90c9 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 200 len: 1318 microversion: 2.1 time: 0.164305 Dec 15 14:40:17.640670 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1158/2238] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:17 2021] GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:18.662902 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b5a7b264-02b8-47c3-b6f0-ee3b96c0ccf0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:18.663710 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b5a7b264-02b8-47c3-b6f0-ee3b96c0ccf0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:18.670863 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5a7b264-02b8-47c3-b6f0-ee3b96c0ccf0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:18.671481 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5a7b264-02b8-47c3-b6f0-ee3b96c0ccf0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:18.672789 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5a7b264-02b8-47c3-b6f0-ee3b96c0ccf0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:18.673230 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5a7b264-02b8-47c3-b6f0-ee3b96c0ccf0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:18.824634 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b5a7b264-02b8-47c3-b6f0-ee3b96c0ccf0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:18.832229 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b5a7b264-02b8-47c3-b6f0-ee3b96c0ccf0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 200 len: 1508 microversion: 2.1 time: 0.174649 Dec 15 14:40:18.833185 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1081/2239] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:18 2021] GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:18.853720 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7b04ddcb-d047-4f2d-88a5-f2eff01f836b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20a0323e-d20a-4697-aad4-05f3da070c93"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:40:18.854856 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7b04ddcb-d047-4f2d-88a5-f2eff01f836b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:18.861794 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b04ddcb-d047-4f2d-88a5-f2eff01f836b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:18.862261 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b04ddcb-d047-4f2d-88a5-f2eff01f836b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:18.863084 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b04ddcb-d047-4f2d-88a5-f2eff01f836b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:18.863512 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b04ddcb-d047-4f2d-88a5-f2eff01f836b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:18.954135 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-7b04ddcb-d047-4f2d-88a5-f2eff01f836b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] HTTP exception thrown: Invalid volume: volume 20a0323e-d20a-4697-aad4-05f3da070c93 is already attached to instances: 1d171d12-9846-4408-8e30-94c02021b71c Dec 15 14:40:18.954905 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7b04ddcb-d047-4f2d-88a5-f2eff01f836b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Returning 400 to user: Invalid volume: volume 20a0323e-d20a-4697-aad4-05f3da070c93 is already attached to instances: 1d171d12-9846-4408-8e30-94c02021b71c {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:40:18.958447 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7b04ddcb-d047-4f2d-88a5-f2eff01f836b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "POST /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107541 Dec 15 14:40:18.958447 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1159/2240] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Dec 15 14:40:18 2021] POST /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 15 14:40:19.024910 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bf7ede9d-adb7-4edf-b5a8-112845955423 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:19.025533 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bf7ede9d-adb7-4edf-b5a8-112845955423 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:19.032303 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf7ede9d-adb7-4edf-b5a8-112845955423 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:19.032751 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf7ede9d-adb7-4edf-b5a8-112845955423 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:19.033576 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf7ede9d-adb7-4edf-b5a8-112845955423 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:19.034052 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf7ede9d-adb7-4edf-b5a8-112845955423 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:19.118284 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-bf7ede9d-adb7-4edf-b5a8-112845955423 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lazy-loading 'services' on Instance uuid 1d171d12-9846-4408-8e30-94c02021b71c {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:40:19.197905 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bf7ede9d-adb7-4edf-b5a8-112845955423 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c/os-volume_attachments/20a0323e-d20a-4697-aad4-05f3da070c93" status: 202 len: 0 microversion: 2.1 time: 0.182267 Dec 15 14:40:19.198727 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1082/2241] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Dec 15 14:40:19 2021] DELETE /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c/os-volume_attachments/20a0323e-d20a-4697-aad4-05f3da070c93 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:40:19.207099 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-597f59bd-77c8-472b-9a6e-f44bb46e2a0f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:19.208130 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-597f59bd-77c8-472b-9a6e-f44bb46e2a0f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:19.214246 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-597f59bd-77c8-472b-9a6e-f44bb46e2a0f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:19.214807 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-597f59bd-77c8-472b-9a6e-f44bb46e2a0f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:19.215720 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-597f59bd-77c8-472b-9a6e-f44bb46e2a0f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:19.216133 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-597f59bd-77c8-472b-9a6e-f44bb46e2a0f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:19.251241 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-597f59bd-77c8-472b-9a6e-f44bb46e2a0f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047697 Dec 15 14:40:19.252193 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1160/2242] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Dec 15 14:40:19 2021] GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:40:20.268628 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-21b42765-ef72-4d72-9158-769f02fe76fc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:20.269655 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-21b42765-ef72-4d72-9158-769f02fe76fc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:20.276344 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21b42765-ef72-4d72-9158-769f02fe76fc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:20.276785 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21b42765-ef72-4d72-9158-769f02fe76fc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:20.277554 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21b42765-ef72-4d72-9158-769f02fe76fc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:20.278019 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21b42765-ef72-4d72-9158-769f02fe76fc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:20.310388 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-21b42765-ef72-4d72-9158-769f02fe76fc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048416 Dec 15 14:40:20.311025 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1083/2243] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Dec 15 14:40:20 2021] GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:40:21.323844 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c7e731ba-a409-499e-a017-20ae8347b76d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:21.324757 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c7e731ba-a409-499e-a017-20ae8347b76d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:21.331445 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c7e731ba-a409-499e-a017-20ae8347b76d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:21.331894 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c7e731ba-a409-499e-a017-20ae8347b76d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:21.332665 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c7e731ba-a409-499e-a017-20ae8347b76d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:21.333162 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c7e731ba-a409-499e-a017-20ae8347b76d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:21.367050 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c7e731ba-a409-499e-a017-20ae8347b76d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047186 Dec 15 14:40:21.367615 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1161/2244] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Dec 15 14:40:21 2021] GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:40:21.545457 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9e625bbd-996c-47d5-87e8-e6d68193b07a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-947290778", "imageRef": "9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7", "flavorRef": "452", "networks": [{"uuid": "06484be5-1b63-4adb-9a9d-8910b46dd895"}]}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:40:21.604622 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-9e625bbd-996c-47d5-87e8-e6d68193b07a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] validate_networks() for [('06484be5-1b63-4adb-9a9d-8910b46dd895', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:40:22.000175 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-9e625bbd-996c-47d5-87e8-e6d68193b07a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:40:22.000903 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-9e625bbd-996c-47d5-87e8-e6d68193b07a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:40:22.001039 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-9e625bbd-996c-47d5-87e8-e6d68193b07a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:40:22.001423 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-9e625bbd-996c-47d5-87e8-e6d68193b07a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:40:22.002055 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-9e625bbd-996c-47d5-87e8-e6d68193b07a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:40:22.014935 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e625bbd-996c-47d5-87e8-e6d68193b07a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:22.016110 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e625bbd-996c-47d5-87e8-e6d68193b07a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:22.017529 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e625bbd-996c-47d5-87e8-e6d68193b07a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:22.018552 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e625bbd-996c-47d5-87e8-e6d68193b07a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:22.039318 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-9e625bbd-996c-47d5-87e8-e6d68193b07a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Getting quotas for project 225b5a61fee14f748a30f2030266c65c. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:40:22.044005 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-9e625bbd-996c-47d5-87e8-e6d68193b07a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Getting quotas for user 4c7378b95dd546ef9572852a4139fb12 and project 225b5a61fee14f748a30f2030266c65c. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:40:22.056595 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9e625bbd-996c-47d5-87e8-e6d68193b07a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:40:22.059101 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9e625bbd-996c-47d5-87e8-e6d68193b07a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:40:22.113760 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9e625bbd-996c-47d5-87e8-e6d68193b07a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574217 Dec 15 14:40:22.114463 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1084/2245] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Dec 15 14:40:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:40:22.124765 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5841119b-3d98-4847-9ded-0026a40f99d7 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:22.125336 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5841119b-3d98-4847-9ded-0026a40f99d7 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:22.191772 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5841119b-3d98-4847-9ded-0026a40f99d7 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:22.201681 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5841119b-3d98-4847-9ded-0026a40f99d7 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 200 len: 1217 microversion: 2.1 time: 0.080842 Dec 15 14:40:22.202265 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1162/2246] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:22 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:40:23.221187 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-623e6340-22dd-4d76-b6e3-492b7fa59218 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:23.221900 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-623e6340-22dd-4d76-b6e3-492b7fa59218 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:23.229022 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-623e6340-22dd-4d76-b6e3-492b7fa59218 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:23.229468 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-623e6340-22dd-4d76-b6e3-492b7fa59218 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:23.230418 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-623e6340-22dd-4d76-b6e3-492b7fa59218 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:23.230847 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-623e6340-22dd-4d76-b6e3-492b7fa59218 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:23.303011 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-623e6340-22dd-4d76-b6e3-492b7fa59218 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:23.315006 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-623e6340-22dd-4d76-b6e3-492b7fa59218 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 200 len: 1213 microversion: 2.1 time: 0.098509 Dec 15 14:40:23.315827 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1085/2247] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:23 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:24.333276 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9a4cebb3-dc93-4bdf-8f8b-83577d90ba56 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:24.334050 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9a4cebb3-dc93-4bdf-8f8b-83577d90ba56 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:24.340534 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a4cebb3-dc93-4bdf-8f8b-83577d90ba56 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:24.340982 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a4cebb3-dc93-4bdf-8f8b-83577d90ba56 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:24.341799 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a4cebb3-dc93-4bdf-8f8b-83577d90ba56 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:24.342240 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9a4cebb3-dc93-4bdf-8f8b-83577d90ba56 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:24.404390 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9a4cebb3-dc93-4bdf-8f8b-83577d90ba56 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:24.412743 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9a4cebb3-dc93-4bdf-8f8b-83577d90ba56 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 200 len: 1213 microversion: 2.1 time: 0.083220 Dec 15 14:40:24.413391 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1163/2248] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:24 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:25.431615 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a298002b-7f49-48ef-93b6-902c525974ea tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:25.432488 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a298002b-7f49-48ef-93b6-902c525974ea tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:25.440682 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a298002b-7f49-48ef-93b6-902c525974ea tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:25.441130 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a298002b-7f49-48ef-93b6-902c525974ea tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:25.441976 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a298002b-7f49-48ef-93b6-902c525974ea tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:25.442432 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a298002b-7f49-48ef-93b6-902c525974ea tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:25.520614 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a298002b-7f49-48ef-93b6-902c525974ea tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:25.531460 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a298002b-7f49-48ef-93b6-902c525974ea tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 200 len: 1213 microversion: 2.1 time: 0.105283 Dec 15 14:40:25.532046 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1086/2249] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:25 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 1213 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:26.552759 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-18cb8448-9271-4c63-9a16-e38a9c9d1eb2 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:26.553411 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-18cb8448-9271-4c63-9a16-e38a9c9d1eb2 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:26.561037 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18cb8448-9271-4c63-9a16-e38a9c9d1eb2 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:26.561588 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18cb8448-9271-4c63-9a16-e38a9c9d1eb2 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:26.562485 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18cb8448-9271-4c63-9a16-e38a9c9d1eb2 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:26.562941 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18cb8448-9271-4c63-9a16-e38a9c9d1eb2 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:26.635774 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-18cb8448-9271-4c63-9a16-e38a9c9d1eb2 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:26.645124 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-18cb8448-9271-4c63-9a16-e38a9c9d1eb2 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 200 len: 1213 microversion: 2.1 time: 0.097655 Dec 15 14:40:26.645956 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1164/2250] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:26 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:27.662871 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d720da8c-0d41-4562-92f0-31de7fe8ecf8 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:27.663580 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d720da8c-0d41-4562-92f0-31de7fe8ecf8 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:27.671390 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d720da8c-0d41-4562-92f0-31de7fe8ecf8 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:27.671857 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d720da8c-0d41-4562-92f0-31de7fe8ecf8 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:27.672629 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d720da8c-0d41-4562-92f0-31de7fe8ecf8 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:27.673067 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d720da8c-0d41-4562-92f0-31de7fe8ecf8 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:27.736513 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d720da8c-0d41-4562-92f0-31de7fe8ecf8 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:27.745644 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d720da8c-0d41-4562-92f0-31de7fe8ecf8 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 200 len: 1269 microversion: 2.1 time: 0.086527 Dec 15 14:40:27.746229 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1087/2251] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:27 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 1269 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:28.766342 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cf0e60ab-6153-481f-a6ac-b4f785d5eb0f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:28.767703 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cf0e60ab-6153-481f-a6ac-b4f785d5eb0f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:28.774574 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf0e60ab-6153-481f-a6ac-b4f785d5eb0f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:28.775023 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf0e60ab-6153-481f-a6ac-b4f785d5eb0f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:28.776008 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf0e60ab-6153-481f-a6ac-b4f785d5eb0f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:28.776683 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf0e60ab-6153-481f-a6ac-b4f785d5eb0f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:29.054472 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cf0e60ab-6153-481f-a6ac-b4f785d5eb0f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:29.067533 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cf0e60ab-6153-481f-a6ac-b4f785d5eb0f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 200 len: 1317 microversion: 2.1 time: 0.304611 Dec 15 14:40:29.068632 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1165/2252] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:28 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:29.520388 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-e4ce31d5-9c33-4eef-ab06-a663be358e19 req-712eba6d-337e-47d7-9c32-80682577dc2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80c56b0a-393b-4606-a1a7-577c7c9a0203", "tag": "316b175d-86ab-436b-95bc-a8e21ac1b3bd"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:40:29.522219 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:40:29.522219 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:40:29.532621 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-e4ce31d5-9c33-4eef-ab06-a663be358e19 req-712eba6d-337e-47d7-9c32-80682577dc2f service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:29.533362 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-e4ce31d5-9c33-4eef-ab06-a663be358e19 req-712eba6d-337e-47d7-9c32-80682577dc2f service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:29.547051 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-e4ce31d5-9c33-4eef-ab06-a663be358e19 req-712eba6d-337e-47d7-9c32-80682577dc2f service nova] Creating event network-changed:316b175d-86ab-436b-95bc-a8e21ac1b3bd for instance 80c56b0a-393b-4606-a1a7-577c7c9a0203 on hv-cinder-82182 Dec 15 14:40:29.553102 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-e4ce31d5-9c33-4eef-ab06-a663be358e19 req-712eba6d-337e-47d7-9c32-80682577dc2f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035951 Dec 15 14:40:29.553775 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1088/2253] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:40:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:40:30.086051 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d3088eb3-bbe0-401d-8ac0-21800edb148a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:30.086799 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d3088eb3-bbe0-401d-8ac0-21800edb148a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:30.094451 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3088eb3-bbe0-401d-8ac0-21800edb148a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:30.094904 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3088eb3-bbe0-401d-8ac0-21800edb148a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:30.095711 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3088eb3-bbe0-401d-8ac0-21800edb148a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:30.096142 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3088eb3-bbe0-401d-8ac0-21800edb148a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:30.329872 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d3088eb3-bbe0-401d-8ac0-21800edb148a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:30.338800 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d3088eb3-bbe0-401d-8ac0-21800edb148a tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 200 len: 1317 microversion: 2.1 time: 0.256679 Dec 15 14:40:30.339547 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1166/2254] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:30 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:31.357602 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d4d6c50b-41a3-4fc1-ad2a-08c7fec02ce0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:31.360010 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d4d6c50b-41a3-4fc1-ad2a-08c7fec02ce0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:31.366067 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4d6c50b-41a3-4fc1-ad2a-08c7fec02ce0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:31.366599 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4d6c50b-41a3-4fc1-ad2a-08c7fec02ce0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:31.367402 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4d6c50b-41a3-4fc1-ad2a-08c7fec02ce0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:31.367829 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4d6c50b-41a3-4fc1-ad2a-08c7fec02ce0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:31.545919 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d4d6c50b-41a3-4fc1-ad2a-08c7fec02ce0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:31.554102 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d4d6c50b-41a3-4fc1-ad2a-08c7fec02ce0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 200 len: 1317 microversion: 2.1 time: 0.201066 Dec 15 14:40:31.554666 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1089/2255] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:31 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:32.575356 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e6609742-d3f8-4ccb-a96d-fd8f3eecfdd7 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:32.576117 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e6609742-d3f8-4ccb-a96d-fd8f3eecfdd7 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:32.583377 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6609742-d3f8-4ccb-a96d-fd8f3eecfdd7 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:32.583821 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6609742-d3f8-4ccb-a96d-fd8f3eecfdd7 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:32.584619 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6609742-d3f8-4ccb-a96d-fd8f3eecfdd7 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:32.585048 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6609742-d3f8-4ccb-a96d-fd8f3eecfdd7 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:32.726332 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e6609742-d3f8-4ccb-a96d-fd8f3eecfdd7 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:32.734211 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e6609742-d3f8-4ccb-a96d-fd8f3eecfdd7 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 200 len: 1317 microversion: 2.1 time: 0.165109 Dec 15 14:40:32.734779 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1167/2256] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:32 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:33.752090 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d6c481d7-d9d1-49b1-b858-202da7fd6332 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:33.752904 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d6c481d7-d9d1-49b1-b858-202da7fd6332 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:33.762448 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d6c481d7-d9d1-49b1-b858-202da7fd6332 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:33.770428 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d6c481d7-d9d1-49b1-b858-202da7fd6332 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:33.770428 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d6c481d7-d9d1-49b1-b858-202da7fd6332 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:33.770428 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d6c481d7-d9d1-49b1-b858-202da7fd6332 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:33.901850 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d6c481d7-d9d1-49b1-b858-202da7fd6332 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:33.909525 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d6c481d7-d9d1-49b1-b858-202da7fd6332 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 200 len: 1317 microversion: 2.1 time: 0.161582 Dec 15 14:40:33.910145 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1090/2257] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:33 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:34.928367 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cfbcebed-d226-40c4-a074-ee1cf06b430c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:34.929040 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cfbcebed-d226-40c4-a074-ee1cf06b430c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:34.935837 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cfbcebed-d226-40c4-a074-ee1cf06b430c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:34.936307 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cfbcebed-d226-40c4-a074-ee1cf06b430c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:34.937071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cfbcebed-d226-40c4-a074-ee1cf06b430c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:34.937517 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cfbcebed-d226-40c4-a074-ee1cf06b430c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:35.093372 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cfbcebed-d226-40c4-a074-ee1cf06b430c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:35.101405 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cfbcebed-d226-40c4-a074-ee1cf06b430c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 200 len: 1317 microversion: 2.1 time: 0.177114 Dec 15 14:40:35.102037 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1168/2258] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:34 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:36.118314 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-63eb3a3b-d2b2-4c85-b94c-a9980390e9c1 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:36.119027 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-63eb3a3b-d2b2-4c85-b94c-a9980390e9c1 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:36.125957 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63eb3a3b-d2b2-4c85-b94c-a9980390e9c1 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:36.126415 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63eb3a3b-d2b2-4c85-b94c-a9980390e9c1 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:36.127201 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63eb3a3b-d2b2-4c85-b94c-a9980390e9c1 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:36.127642 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63eb3a3b-d2b2-4c85-b94c-a9980390e9c1 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:36.265722 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-63eb3a3b-d2b2-4c85-b94c-a9980390e9c1 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:36.274026 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-63eb3a3b-d2b2-4c85-b94c-a9980390e9c1 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 200 len: 1317 microversion: 2.1 time: 0.159410 Dec 15 14:40:36.274660 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1091/2259] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:36 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:36.884145 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-5a2bb693-a801-45d4-9fac-98e208edb3dd req-bd9972f6-1d94-4015-a063-c0b456b6f4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c56b0a-393b-4606-a1a7-577c7c9a0203", "name": "network-vif-plugged", "status": "completed", "tag": "316b175d-86ab-436b-95bc-a8e21ac1b3bd"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:40:36.885765 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:40:36.885765 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:40:36.897891 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-5a2bb693-a801-45d4-9fac-98e208edb3dd req-bd9972f6-1d94-4015-a063-c0b456b6f4f1 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:36.898704 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-5a2bb693-a801-45d4-9fac-98e208edb3dd req-bd9972f6-1d94-4015-a063-c0b456b6f4f1 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:36.920073 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-5a2bb693-a801-45d4-9fac-98e208edb3dd req-bd9972f6-1d94-4015-a063-c0b456b6f4f1 service nova] Creating event network-vif-plugged:316b175d-86ab-436b-95bc-a8e21ac1b3bd for instance 80c56b0a-393b-4606-a1a7-577c7c9a0203 on hv-cinder-82182 Dec 15 14:40:36.929268 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-5a2bb693-a801-45d4-9fac-98e208edb3dd req-bd9972f6-1d94-4015-a063-c0b456b6f4f1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048075 Dec 15 14:40:36.930373 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1169/2260] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:40:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:40:37.106260 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9e42f162-e914-478d-8a80-9e7d0222cdf8 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-881904723", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-567869390", "security_groups": [{"name": "tempest-secgroup-smoke-88561615"}], "block_device_mapping_v2": [{"uuid": "fc9d7e0c-5a68-47f3-9d0e-ea54c7330dd8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d33d9d6-f65d-49df-b4e4-2047aa765843"}]}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:40:37.253577 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-9e42f162-e914-478d-8a80-9e7d0222cdf8 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] validate_networks() for [('8d33d9d6-f65d-49df-b4e4-2047aa765843', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:40:37.292165 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0fa568ae-17ec-44f9-8063-3fcfb10469af tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:37.292735 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0fa568ae-17ec-44f9-8063-3fcfb10469af tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:37.299123 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0fa568ae-17ec-44f9-8063-3fcfb10469af tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:37.299567 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0fa568ae-17ec-44f9-8063-3fcfb10469af tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:37.300353 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0fa568ae-17ec-44f9-8063-3fcfb10469af tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:37.300787 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0fa568ae-17ec-44f9-8063-3fcfb10469af tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:37.506058 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0fa568ae-17ec-44f9-8063-3fcfb10469af tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:37.513898 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0fa568ae-17ec-44f9-8063-3fcfb10469af tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 200 len: 1317 microversion: 2.1 time: 0.226740 Dec 15 14:40:37.514537 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1170/2261] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:37 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:40:37.739924 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-9e42f162-e914-478d-8a80-9e7d0222cdf8 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:40:37.740344 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-9e42f162-e914-478d-8a80-9e7d0222cdf8 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:40:37.740818 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-9e42f162-e914-478d-8a80-9e7d0222cdf8 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:40:37.741227 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-9e42f162-e914-478d-8a80-9e7d0222cdf8 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:40:37.741653 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-9e42f162-e914-478d-8a80-9e7d0222cdf8 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:40:37.751540 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e42f162-e914-478d-8a80-9e7d0222cdf8 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:37.752058 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e42f162-e914-478d-8a80-9e7d0222cdf8 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:37.752870 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e42f162-e914-478d-8a80-9e7d0222cdf8 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:37.753306 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e42f162-e914-478d-8a80-9e7d0222cdf8 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:37.770691 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-9e42f162-e914-478d-8a80-9e7d0222cdf8 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Getting quotas for project 8c64dae61ceb4d9280a759bf3f111c80. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:40:37.774763 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-9e42f162-e914-478d-8a80-9e7d0222cdf8 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Getting quotas for user 192b688b02c6455dbc4cdb22e7023521 and project 8c64dae61ceb4d9280a759bf3f111c80. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:40:37.833424 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9e42f162-e914-478d-8a80-9e7d0222cdf8 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:40:37.835643 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9e42f162-e914-478d-8a80-9e7d0222cdf8 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fc9d7e0c-5a68-47f3-9d0e-ea54c7330dd8',volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:40:37.966717 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9e42f162-e914-478d-8a80-9e7d0222cdf8 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.864958 Dec 15 14:40:37.967355 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1092/2262] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Dec 15 14:40:37 2021] POST /compute/v2.1/servers => generated 404 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:40:37.977323 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ac41fde9-072b-4d03-8b29-052c7843916f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:37.978073 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ac41fde9-072b-4d03-8b29-052c7843916f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:38.050527 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ac41fde9-072b-4d03-8b29-052c7843916f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:38.057928 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ac41fde9-072b-4d03-8b29-052c7843916f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1093 microversion: 2.1 time: 0.084163 Dec 15 14:40:38.058565 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1171/2263] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:37 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1093 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:40:38.532336 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-127e3624-e2c6-4f10-8b01-77b001e3e6c7 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:38.533058 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-127e3624-e2c6-4f10-8b01-77b001e3e6c7 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:38.540594 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-127e3624-e2c6-4f10-8b01-77b001e3e6c7 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:38.541886 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-127e3624-e2c6-4f10-8b01-77b001e3e6c7 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:38.542815 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-127e3624-e2c6-4f10-8b01-77b001e3e6c7 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:38.543486 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-127e3624-e2c6-4f10-8b01-77b001e3e6c7 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:38.700173 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-127e3624-e2c6-4f10-8b01-77b001e3e6c7 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:38.708828 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-127e3624-e2c6-4f10-8b01-77b001e3e6c7 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 200 len: 1317 microversion: 2.1 time: 0.180655 Dec 15 14:40:38.709405 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1093/2264] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:38 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:39.079421 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1da834f9-a7f9-40a7-b76d-da264d943008 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:39.080292 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1da834f9-a7f9-40a7-b76d-da264d943008 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:39.088470 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1da834f9-a7f9-40a7-b76d-da264d943008 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:39.088879 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1da834f9-a7f9-40a7-b76d-da264d943008 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:39.089775 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1da834f9-a7f9-40a7-b76d-da264d943008 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:39.090199 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1da834f9-a7f9-40a7-b76d-da264d943008 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:39.175459 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1da834f9-a7f9-40a7-b76d-da264d943008 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:39.184156 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1da834f9-a7f9-40a7-b76d-da264d943008 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1199 microversion: 2.1 time: 0.108476 Dec 15 14:40:39.184790 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1172/2265] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:39 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1199 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:40:39.729800 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-38e61622-11cc-4a0f-bf77-a0a24a93aaae tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:39.731151 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-38e61622-11cc-4a0f-bf77-a0a24a93aaae tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:39.741852 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38e61622-11cc-4a0f-bf77-a0a24a93aaae tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:39.742394 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38e61622-11cc-4a0f-bf77-a0a24a93aaae tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:39.743823 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38e61622-11cc-4a0f-bf77-a0a24a93aaae tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:39.743890 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38e61622-11cc-4a0f-bf77-a0a24a93aaae tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:40.212515 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ab8da584-923d-4296-95bc-0fa200c76897 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:40.215612 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ab8da584-923d-4296-95bc-0fa200c76897 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:40.227070 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ab8da584-923d-4296-95bc-0fa200c76897 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:40.227722 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ab8da584-923d-4296-95bc-0fa200c76897 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:40.228694 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ab8da584-923d-4296-95bc-0fa200c76897 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:40.229312 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ab8da584-923d-4296-95bc-0fa200c76897 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:40.289864 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-38e61622-11cc-4a0f-bf77-a0a24a93aaae tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:40.300100 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-38e61622-11cc-4a0f-bf77-a0a24a93aaae tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 200 len: 1507 microversion: 2.1 time: 0.577530 Dec 15 14:40:40.301063 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1094/2266] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:39 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 1507 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:40.498772 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ab8da584-923d-4296-95bc-0fa200c76897 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:40.511544 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ab8da584-923d-4296-95bc-0fa200c76897 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1263 microversion: 2.1 time: 0.307949 Dec 15 14:40:40.513086 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1173/2267] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:40 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1263 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:40:41.018779 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-044fb252-c031-4334-822e-37350ff207be req-22cae1f3-93ee-452a-ae41-9ee588e8fea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8115b3e6-ac36-405e-a868-eea90e723391", "tag": "a3a04721-267d-4263-ba76-a6af16c811e2"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:40:41.020764 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:40:41.020764 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:40:41.028884 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-044fb252-c031-4334-822e-37350ff207be req-22cae1f3-93ee-452a-ae41-9ee588e8fea8 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:41.029324 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-044fb252-c031-4334-822e-37350ff207be req-22cae1f3-93ee-452a-ae41-9ee588e8fea8 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:41.046230 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-044fb252-c031-4334-822e-37350ff207be req-22cae1f3-93ee-452a-ae41-9ee588e8fea8 service nova] Creating event network-changed:a3a04721-267d-4263-ba76-a6af16c811e2 for instance 8115b3e6-ac36-405e-a868-eea90e723391 on hv-cinder-82182 Dec 15 14:40:41.052171 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-044fb252-c031-4334-822e-37350ff207be req-22cae1f3-93ee-452a-ae41-9ee588e8fea8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037961 Dec 15 14:40:41.052780 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1095/2268] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:40:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:40:41.528963 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-67136d72-fa26-418c-a72b-6e629f55eb58 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:41.529697 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-67136d72-fa26-418c-a72b-6e629f55eb58 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:41.536360 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67136d72-fa26-418c-a72b-6e629f55eb58 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:41.536802 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67136d72-fa26-418c-a72b-6e629f55eb58 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:41.537581 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67136d72-fa26-418c-a72b-6e629f55eb58 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:41.538032 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67136d72-fa26-418c-a72b-6e629f55eb58 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:41.739672 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a22296b4-d098-40a3-a116-057165996729 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "426af379-7e96-4a4b-aa52-04cb491673b6"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:40:41.740826 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a22296b4-d098-40a3-a116-057165996729 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:41.747758 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a22296b4-d098-40a3-a116-057165996729 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:41.748211 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a22296b4-d098-40a3-a116-057165996729 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:41.749052 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a22296b4-d098-40a3-a116-057165996729 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:41.749490 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a22296b4-d098-40a3-a116-057165996729 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:41.780000 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-67136d72-fa26-418c-a72b-6e629f55eb58 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:41.787181 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-67136d72-fa26-418c-a72b-6e629f55eb58 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1263 microversion: 2.1 time: 0.262436 Dec 15 14:40:41.787723 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1174/2269] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:41 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1263 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:42.037534 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a22296b4-d098-40a3-a116-057165996729 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "POST /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301853 Dec 15 14:40:42.039003 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1096/2270] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Dec 15 14:40:41 2021] POST /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:40:42.804858 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a7a4e53f-811c-4b36-9f4f-a540f4b36d19 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:42.805434 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a7a4e53f-811c-4b36-9f4f-a540f4b36d19 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:42.812413 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7a4e53f-811c-4b36-9f4f-a540f4b36d19 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:42.812869 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7a4e53f-811c-4b36-9f4f-a540f4b36d19 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:42.813663 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7a4e53f-811c-4b36-9f4f-a540f4b36d19 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:42.814122 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7a4e53f-811c-4b36-9f4f-a540f4b36d19 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:42.957449 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a7a4e53f-811c-4b36-9f4f-a540f4b36d19 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:42.965268 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a7a4e53f-811c-4b36-9f4f-a540f4b36d19 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1263 microversion: 2.1 time: 0.164330 Dec 15 14:40:42.965873 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1175/2271] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:42 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:43.983436 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9a8ddeb0-cb87-4012-8ae2-0c8288cc5b4a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:43.984129 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9a8ddeb0-cb87-4012-8ae2-0c8288cc5b4a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:43.991545 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a8ddeb0-cb87-4012-8ae2-0c8288cc5b4a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:43.991983 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a8ddeb0-cb87-4012-8ae2-0c8288cc5b4a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:43.992783 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a8ddeb0-cb87-4012-8ae2-0c8288cc5b4a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:43.993213 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a8ddeb0-cb87-4012-8ae2-0c8288cc5b4a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:44.140031 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9a8ddeb0-cb87-4012-8ae2-0c8288cc5b4a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:44.148792 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9a8ddeb0-cb87-4012-8ae2-0c8288cc5b4a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1263 microversion: 2.1 time: 0.169773 Dec 15 14:40:44.149440 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1097/2272] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:43 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1263 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:45.168192 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-62993086-f164-4a9f-9be9-6f83199c560c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:45.168966 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-62993086-f164-4a9f-9be9-6f83199c560c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:45.175634 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62993086-f164-4a9f-9be9-6f83199c560c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:45.176136 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62993086-f164-4a9f-9be9-6f83199c560c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:45.176906 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62993086-f164-4a9f-9be9-6f83199c560c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:45.177436 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62993086-f164-4a9f-9be9-6f83199c560c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:45.324254 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-62993086-f164-4a9f-9be9-6f83199c560c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:45.334762 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-62993086-f164-4a9f-9be9-6f83199c560c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1263 microversion: 2.1 time: 0.171353 Dec 15 14:40:45.335712 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1176/2273] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:45 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:46.352962 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-98715170-50a5-4314-8383-d9a36ab409e2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:46.353976 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-98715170-50a5-4314-8383-d9a36ab409e2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:46.360941 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98715170-50a5-4314-8383-d9a36ab409e2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:46.361397 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98715170-50a5-4314-8383-d9a36ab409e2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:46.362223 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98715170-50a5-4314-8383-d9a36ab409e2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:46.362659 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98715170-50a5-4314-8383-d9a36ab409e2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:46.515201 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-98715170-50a5-4314-8383-d9a36ab409e2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:46.523436 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-98715170-50a5-4314-8383-d9a36ab409e2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1263 microversion: 2.1 time: 0.174601 Dec 15 14:40:46.524022 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1098/2274] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:46 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1263 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:47.545463 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5122b118-e7cd-4fe3-a914-dfc27b446ef5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:47.546336 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5122b118-e7cd-4fe3-a914-dfc27b446ef5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:47.556832 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5122b118-e7cd-4fe3-a914-dfc27b446ef5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:47.557293 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5122b118-e7cd-4fe3-a914-dfc27b446ef5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:47.558119 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5122b118-e7cd-4fe3-a914-dfc27b446ef5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:47.558558 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5122b118-e7cd-4fe3-a914-dfc27b446ef5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:47.718611 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5122b118-e7cd-4fe3-a914-dfc27b446ef5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:47.730112 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5122b118-e7cd-4fe3-a914-dfc27b446ef5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1263 microversion: 2.1 time: 0.191816 Dec 15 14:40:47.730699 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1177/2275] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:47 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1263 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:48.752608 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d177b6a2-79cd-411a-abb0-13546b3b4611 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:48.753149 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d177b6a2-79cd-411a-abb0-13546b3b4611 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:48.760013 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d177b6a2-79cd-411a-abb0-13546b3b4611 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:48.760462 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d177b6a2-79cd-411a-abb0-13546b3b4611 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:48.761340 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d177b6a2-79cd-411a-abb0-13546b3b4611 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:48.762398 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d177b6a2-79cd-411a-abb0-13546b3b4611 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:48.903926 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d177b6a2-79cd-411a-abb0-13546b3b4611 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:48.912197 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d177b6a2-79cd-411a-abb0-13546b3b4611 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1263 microversion: 2.1 time: 0.163405 Dec 15 14:40:48.912776 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1099/2276] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:48 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:49.555208 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-363e266f-68f9-438b-bd2e-0ff3450a5fb8 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "426af379-7e96-4a4b-aa52-04cb491673b6"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:40:49.556335 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-363e266f-68f9-438b-bd2e-0ff3450a5fb8 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:49.562850 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-363e266f-68f9-438b-bd2e-0ff3450a5fb8 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:49.563297 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-363e266f-68f9-438b-bd2e-0ff3450a5fb8 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:49.564067 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-363e266f-68f9-438b-bd2e-0ff3450a5fb8 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:49.564501 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-363e266f-68f9-438b-bd2e-0ff3450a5fb8 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:49.654776 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-363e266f-68f9-438b-bd2e-0ff3450a5fb8 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] HTTP exception thrown: Invalid volume: volume 426af379-7e96-4a4b-aa52-04cb491673b6 is already attached to instances: 80c56b0a-393b-4606-a1a7-577c7c9a0203 Dec 15 14:40:49.655643 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-363e266f-68f9-438b-bd2e-0ff3450a5fb8 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Returning 400 to user: Invalid volume: volume 426af379-7e96-4a4b-aa52-04cb491673b6 is already attached to instances: 80c56b0a-393b-4606-a1a7-577c7c9a0203 {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:40:49.656606 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-363e266f-68f9-438b-bd2e-0ff3450a5fb8 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "POST /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105270 Dec 15 14:40:49.657503 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1178/2277] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Dec 15 14:40:49 2021] POST /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 14:40:49.720725 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5c9f92f1-25fc-4694-a009-0495adf22321 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:49.721220 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5c9f92f1-25fc-4694-a009-0495adf22321 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:49.727425 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c9f92f1-25fc-4694-a009-0495adf22321 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:49.727872 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c9f92f1-25fc-4694-a009-0495adf22321 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:49.728640 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c9f92f1-25fc-4694-a009-0495adf22321 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:49.729087 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c9f92f1-25fc-4694-a009-0495adf22321 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:49.816429 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-5c9f92f1-25fc-4694-a009-0495adf22321 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lazy-loading 'services' on Instance uuid 80c56b0a-393b-4606-a1a7-577c7c9a0203 {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:40:49.905245 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5c9f92f1-25fc-4694-a009-0495adf22321 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "DELETE /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203/os-volume_attachments/426af379-7e96-4a4b-aa52-04cb491673b6" status: 202 len: 0 microversion: 2.1 time: 0.188195 Dec 15 14:40:49.905888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1100/2278] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Dec 15 14:40:49 2021] DELETE /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203/os-volume_attachments/426af379-7e96-4a4b-aa52-04cb491673b6 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:40:49.915067 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b929316b-9e60-4902-b319-1859a0625b7f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:49.916468 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b929316b-9e60-4902-b319-1859a0625b7f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:49.922993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b929316b-9e60-4902-b319-1859a0625b7f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:49.923524 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b929316b-9e60-4902-b319-1859a0625b7f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:49.924412 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b929316b-9e60-4902-b319-1859a0625b7f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:49.924915 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b929316b-9e60-4902-b319-1859a0625b7f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:49.936311 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4d3f5e5a-fc7a-46ad-b8b4-0968d1fbac5d tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:49.937098 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4d3f5e5a-fc7a-46ad-b8b4-0968d1fbac5d tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:49.943634 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d3f5e5a-fc7a-46ad-b8b4-0968d1fbac5d tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:49.944095 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d3f5e5a-fc7a-46ad-b8b4-0968d1fbac5d tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:49.944892 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d3f5e5a-fc7a-46ad-b8b4-0968d1fbac5d tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:49.945316 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d3f5e5a-fc7a-46ad-b8b4-0968d1fbac5d tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:49.968810 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b929316b-9e60-4902-b319-1859a0625b7f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058309 Dec 15 14:40:49.969374 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1179/2279] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Dec 15 14:40:49 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:40:50.101831 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4d3f5e5a-fc7a-46ad-b8b4-0968d1fbac5d tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:50.109451 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4d3f5e5a-fc7a-46ad-b8b4-0968d1fbac5d tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1263 microversion: 2.1 time: 0.177684 Dec 15 14:40:50.110135 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1101/2280] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:49 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1263 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:40:50.980642 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-68aed8ef-a589-4843-a169-d04be488c052 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:50.981725 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-68aed8ef-a589-4843-a169-d04be488c052 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:50.988594 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68aed8ef-a589-4843-a169-d04be488c052 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:50.989044 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68aed8ef-a589-4843-a169-d04be488c052 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:50.989913 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68aed8ef-a589-4843-a169-d04be488c052 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:50.990401 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68aed8ef-a589-4843-a169-d04be488c052 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:51.022057 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-68aed8ef-a589-4843-a169-d04be488c052 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045334 Dec 15 14:40:51.022634 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1180/2281] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Dec 15 14:40:50 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:40:51.126497 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-98ffb846-36c5-4312-ad43-70660b1391c2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:51.127261 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-98ffb846-36c5-4312-ad43-70660b1391c2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:51.134261 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98ffb846-36c5-4312-ad43-70660b1391c2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:51.134806 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98ffb846-36c5-4312-ad43-70660b1391c2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:51.135670 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98ffb846-36c5-4312-ad43-70660b1391c2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:51.136162 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98ffb846-36c5-4312-ad43-70660b1391c2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:51.187023 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-78be4b3a-e85e-48ae-9b55-a3bf3fec7379 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-590446342", "imageRef": "9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7", "flavorRef": "452", "networks": [{"uuid": "06484be5-1b63-4adb-9a9d-8910b46dd895"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:40:51.241008 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-78be4b3a-e85e-48ae-9b55-a3bf3fec7379 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] validate_networks() for [('06484be5-1b63-4adb-9a9d-8910b46dd895', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:40:51.385841 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-98ffb846-36c5-4312-ad43-70660b1391c2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:51.394194 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-98ffb846-36c5-4312-ad43-70660b1391c2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1263 microversion: 2.1 time: 0.271734 Dec 15 14:40:51.394791 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1102/2282] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:51 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1263 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:51.925770 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-78be4b3a-e85e-48ae-9b55-a3bf3fec7379 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:40:51.926282 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-78be4b3a-e85e-48ae-9b55-a3bf3fec7379 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:40:51.926754 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-78be4b3a-e85e-48ae-9b55-a3bf3fec7379 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:40:51.927156 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-78be4b3a-e85e-48ae-9b55-a3bf3fec7379 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:40:51.927575 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-78be4b3a-e85e-48ae-9b55-a3bf3fec7379 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:40:51.938069 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-78be4b3a-e85e-48ae-9b55-a3bf3fec7379 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:51.938507 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-78be4b3a-e85e-48ae-9b55-a3bf3fec7379 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:51.939302 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-78be4b3a-e85e-48ae-9b55-a3bf3fec7379 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:51.939730 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-78be4b3a-e85e-48ae-9b55-a3bf3fec7379 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:51.957214 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-78be4b3a-e85e-48ae-9b55-a3bf3fec7379 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Getting quotas for project 225b5a61fee14f748a30f2030266c65c. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:40:51.961328 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-78be4b3a-e85e-48ae-9b55-a3bf3fec7379 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Getting quotas for user 4c7378b95dd546ef9572852a4139fb12 and project 225b5a61fee14f748a30f2030266c65c. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:40:51.972764 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-78be4b3a-e85e-48ae-9b55-a3bf3fec7379 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:40:51.975256 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-78be4b3a-e85e-48ae-9b55-a3bf3fec7379 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9dc9936f-d31b-4cbf-9ffa-bbd47844a8d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:40:52.020744 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-78be4b3a-e85e-48ae-9b55-a3bf3fec7379 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838248 Dec 15 14:40:52.021783 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1181/2283] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Dec 15 14:40:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 14:40:52.038550 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d0f24309-fbb4-4a36-9433-0df037513742 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:52.039256 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d0f24309-fbb4-4a36-9433-0df037513742 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:52.097637 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d0f24309-fbb4-4a36-9433-0df037513742 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:52.104588 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d0f24309-fbb4-4a36-9433-0df037513742 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431" status: 200 len: 1217 microversion: 2.1 time: 0.069856 Dec 15 14:40:52.105197 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1103/2284] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:52 2021] GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:52.412112 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a8080e2c-9c50-4d01-a3c8-c0ddda6e3361 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:52.413034 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a8080e2c-9c50-4d01-a3c8-c0ddda6e3361 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:52.421134 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a8080e2c-9c50-4d01-a3c8-c0ddda6e3361 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:52.421646 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a8080e2c-9c50-4d01-a3c8-c0ddda6e3361 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:52.422665 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a8080e2c-9c50-4d01-a3c8-c0ddda6e3361 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:52.423177 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a8080e2c-9c50-4d01-a3c8-c0ddda6e3361 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:52.571757 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a8080e2c-9c50-4d01-a3c8-c0ddda6e3361 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:52.581670 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a8080e2c-9c50-4d01-a3c8-c0ddda6e3361 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1263 microversion: 2.1 time: 0.174172 Dec 15 14:40:52.582253 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1182/2285] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:52 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1263 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:52.950304 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-a0c1cc8f-ee99-4446-9204-d67a329e4552 req-f0d59ec1-edfd-4f69-a4a2-5392a02c8ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8115b3e6-ac36-405e-a868-eea90e723391", "name": "network-vif-plugged", "status": "completed", "tag": "a3a04721-267d-4263-ba76-a6af16c811e2"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:40:52.952216 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:40:52.952216 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:40:52.962796 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-a0c1cc8f-ee99-4446-9204-d67a329e4552 req-f0d59ec1-edfd-4f69-a4a2-5392a02c8ce2 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:52.963260 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-a0c1cc8f-ee99-4446-9204-d67a329e4552 req-f0d59ec1-edfd-4f69-a4a2-5392a02c8ce2 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:52.976056 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-a0c1cc8f-ee99-4446-9204-d67a329e4552 req-f0d59ec1-edfd-4f69-a4a2-5392a02c8ce2 service nova] Creating event network-vif-plugged:a3a04721-267d-4263-ba76-a6af16c811e2 for instance 8115b3e6-ac36-405e-a868-eea90e723391 on hv-cinder-82182 Dec 15 14:40:52.981062 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-a0c1cc8f-ee99-4446-9204-d67a329e4552 req-f0d59ec1-edfd-4f69-a4a2-5392a02c8ce2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034392 Dec 15 14:40:52.981824 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1104/2286] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:40:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:40:53.126244 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0bf2d103-7054-40d0-9ab5-256b23f04623 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:53.127162 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0bf2d103-7054-40d0-9ab5-256b23f04623 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:53.136258 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0bf2d103-7054-40d0-9ab5-256b23f04623 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:53.136870 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0bf2d103-7054-40d0-9ab5-256b23f04623 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:53.138124 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0bf2d103-7054-40d0-9ab5-256b23f04623 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:53.138966 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0bf2d103-7054-40d0-9ab5-256b23f04623 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:53.229513 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0bf2d103-7054-40d0-9ab5-256b23f04623 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:53.237925 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0bf2d103-7054-40d0-9ab5-256b23f04623 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431" status: 200 len: 1277 microversion: 2.1 time: 0.117294 Dec 15 14:40:53.239075 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1183/2287] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:53 2021] GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431 => generated 1277 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:53.603801 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cc983b67-1052-44cb-bebd-ff73312fc7f9 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:53.604499 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cc983b67-1052-44cb-bebd-ff73312fc7f9 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:53.611220 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc983b67-1052-44cb-bebd-ff73312fc7f9 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:53.611670 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc983b67-1052-44cb-bebd-ff73312fc7f9 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:53.612473 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc983b67-1052-44cb-bebd-ff73312fc7f9 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:53.613037 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc983b67-1052-44cb-bebd-ff73312fc7f9 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:53.874411 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cc983b67-1052-44cb-bebd-ff73312fc7f9 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:53.881996 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cc983b67-1052-44cb-bebd-ff73312fc7f9 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1263 microversion: 2.1 time: 0.282353 Dec 15 14:40:53.882596 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1105/2288] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:53 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1263 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:40:54.255490 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e58a265e-dfd8-418e-8fd9-8266ea199e7b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:54.256100 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e58a265e-dfd8-418e-8fd9-8266ea199e7b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:54.263406 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e58a265e-dfd8-418e-8fd9-8266ea199e7b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:54.263913 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e58a265e-dfd8-418e-8fd9-8266ea199e7b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:54.264789 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e58a265e-dfd8-418e-8fd9-8266ea199e7b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:54.265210 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e58a265e-dfd8-418e-8fd9-8266ea199e7b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:54.484719 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e58a265e-dfd8-418e-8fd9-8266ea199e7b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:54.492614 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e58a265e-dfd8-418e-8fd9-8266ea199e7b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431" status: 200 len: 1317 microversion: 2.1 time: 0.240839 Dec 15 14:40:54.493201 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1184/2289] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:54 2021] GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:54.782259 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-3f4e0084-3bac-4b61-bc0b-ea7b7909b36d req-380dac3b-07ec-4ef0-a143-c29d9bba404a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2644eb-81de-42cf-b256-2ac784433431", "tag": "56ebdc0e-d1a6-4e19-94f0-3fb635321186"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:40:54.783849 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:40:54.783849 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:40:54.800015 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-3f4e0084-3bac-4b61-bc0b-ea7b7909b36d req-380dac3b-07ec-4ef0-a143-c29d9bba404a service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:54.800703 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-3f4e0084-3bac-4b61-bc0b-ea7b7909b36d req-380dac3b-07ec-4ef0-a143-c29d9bba404a service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:54.814348 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-3f4e0084-3bac-4b61-bc0b-ea7b7909b36d req-380dac3b-07ec-4ef0-a143-c29d9bba404a service nova] Creating event network-changed:56ebdc0e-d1a6-4e19-94f0-3fb635321186 for instance 2c2644eb-81de-42cf-b256-2ac784433431 on hv-cinder-82182 Dec 15 14:40:54.820025 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-3f4e0084-3bac-4b61-bc0b-ea7b7909b36d req-380dac3b-07ec-4ef0-a143-c29d9bba404a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042951 Dec 15 14:40:54.820662 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1106/2290] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:40:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:40:54.899143 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d2ad35c3-e1ca-4fbf-b2e0-43aa96f5134c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:54.899681 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d2ad35c3-e1ca-4fbf-b2e0-43aa96f5134c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:54.906631 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2ad35c3-e1ca-4fbf-b2e0-43aa96f5134c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:54.907083 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2ad35c3-e1ca-4fbf-b2e0-43aa96f5134c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:54.907865 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2ad35c3-e1ca-4fbf-b2e0-43aa96f5134c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:54.908297 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2ad35c3-e1ca-4fbf-b2e0-43aa96f5134c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:55.118814 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d2ad35c3-e1ca-4fbf-b2e0-43aa96f5134c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:55.126731 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d2ad35c3-e1ca-4fbf-b2e0-43aa96f5134c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1263 microversion: 2.1 time: 0.231282 Dec 15 14:40:55.127362 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1185/2291] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:54 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1263 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:55.510990 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0b2e58b9-00a7-4217-a0df-acfe7e5bf725 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:55.511711 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0b2e58b9-00a7-4217-a0df-acfe7e5bf725 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:55.518823 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b2e58b9-00a7-4217-a0df-acfe7e5bf725 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:55.519266 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b2e58b9-00a7-4217-a0df-acfe7e5bf725 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:55.520375 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b2e58b9-00a7-4217-a0df-acfe7e5bf725 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:55.520801 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b2e58b9-00a7-4217-a0df-acfe7e5bf725 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:55.769235 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0b2e58b9-00a7-4217-a0df-acfe7e5bf725 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:55.777263 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0b2e58b9-00a7-4217-a0df-acfe7e5bf725 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431" status: 200 len: 1317 microversion: 2.1 time: 0.270368 Dec 15 14:40:55.778240 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1107/2292] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:55 2021] GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:56.144158 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1d14a861-1b9e-4080-8a1e-d03decd8bc3f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:56.144821 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1d14a861-1b9e-4080-8a1e-d03decd8bc3f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:56.153536 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d14a861-1b9e-4080-8a1e-d03decd8bc3f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:56.154301 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d14a861-1b9e-4080-8a1e-d03decd8bc3f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:56.156426 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d14a861-1b9e-4080-8a1e-d03decd8bc3f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:56.157155 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d14a861-1b9e-4080-8a1e-d03decd8bc3f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:56.613634 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1d14a861-1b9e-4080-8a1e-d03decd8bc3f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:56.622025 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1d14a861-1b9e-4080-8a1e-d03decd8bc3f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1449 microversion: 2.1 time: 0.481602 Dec 15 14:40:56.622621 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1186/2293] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:56 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1449 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:56.638912 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-195d44dc-fa6c-44ca-8505-5c70e23abffd tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:56.640231 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-195d44dc-fa6c-44ca-8505-5c70e23abffd tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:56.647405 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-195d44dc-fa6c-44ca-8505-5c70e23abffd tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:56.647886 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-195d44dc-fa6c-44ca-8505-5c70e23abffd tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:56.648722 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-195d44dc-fa6c-44ca-8505-5c70e23abffd tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:56.649186 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-195d44dc-fa6c-44ca-8505-5c70e23abffd tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:56.794315 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-195d44dc-fa6c-44ca-8505-5c70e23abffd tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:56.796114 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5fd483bf-254a-4918-99d2-8e858d1a03c6 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:56.796906 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5fd483bf-254a-4918-99d2-8e858d1a03c6 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:56.803096 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-195d44dc-fa6c-44ca-8505-5c70e23abffd tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1449 microversion: 2.1 time: 0.167943 Dec 15 14:40:56.803232 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5fd483bf-254a-4918-99d2-8e858d1a03c6 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:56.803637 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5fd483bf-254a-4918-99d2-8e858d1a03c6 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:56.803726 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1108/2294] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:56 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1449 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:56.804429 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5fd483bf-254a-4918-99d2-8e858d1a03c6 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:56.804867 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5fd483bf-254a-4918-99d2-8e858d1a03c6 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:56.942899 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5fd483bf-254a-4918-99d2-8e858d1a03c6 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:56.950762 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5fd483bf-254a-4918-99d2-8e858d1a03c6 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431" status: 200 len: 1317 microversion: 2.1 time: 0.158921 Dec 15 14:40:56.951452 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1187/2295] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:56 2021] GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:57.968631 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ffca8872-39bd-48b0-8dc2-58b1131ca44e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:57.969341 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ffca8872-39bd-48b0-8dc2-58b1131ca44e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:57.978163 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffca8872-39bd-48b0-8dc2-58b1131ca44e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:57.978163 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffca8872-39bd-48b0-8dc2-58b1131ca44e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:57.979038 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffca8872-39bd-48b0-8dc2-58b1131ca44e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:57.979504 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffca8872-39bd-48b0-8dc2-58b1131ca44e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:58.212754 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ffca8872-39bd-48b0-8dc2-58b1131ca44e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:58.220745 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ffca8872-39bd-48b0-8dc2-58b1131ca44e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431" status: 200 len: 1317 microversion: 2.1 time: 0.256670 Dec 15 14:40:58.221362 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1109/2296] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:57 2021] GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431 => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:40:58.840448 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-d52908cb-0873-4578-b714-7dcc4c2afe1e req-3dc19cc6-e4ee-4027-972d-8ddef07eb54c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8115b3e6-ac36-405e-a868-eea90e723391", "tag": "a3a04721-267d-4263-ba76-a6af16c811e2"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:40:58.843119 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:40:58.843119 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:40:58.851399 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-d52908cb-0873-4578-b714-7dcc4c2afe1e req-3dc19cc6-e4ee-4027-972d-8ddef07eb54c service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:58.851924 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-d52908cb-0873-4578-b714-7dcc4c2afe1e req-3dc19cc6-e4ee-4027-972d-8ddef07eb54c service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:58.863764 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-d52908cb-0873-4578-b714-7dcc4c2afe1e req-3dc19cc6-e4ee-4027-972d-8ddef07eb54c service nova] Creating event network-changed:a3a04721-267d-4263-ba76-a6af16c811e2 for instance 8115b3e6-ac36-405e-a868-eea90e723391 on hv-cinder-82182 Dec 15 14:40:58.868912 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-d52908cb-0873-4578-b714-7dcc4c2afe1e req-3dc19cc6-e4ee-4027-972d-8ddef07eb54c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033222 Dec 15 14:40:58.869563 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1188/2297] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:40:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:40:59.239811 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e958ed77-de16-4898-94dd-16cdb00234c2 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:40:59.240410 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e958ed77-de16-4898-94dd-16cdb00234c2 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:40:59.247229 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e958ed77-de16-4898-94dd-16cdb00234c2 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:59.247760 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e958ed77-de16-4898-94dd-16cdb00234c2 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:59.248725 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e958ed77-de16-4898-94dd-16cdb00234c2 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:40:59.249152 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e958ed77-de16-4898-94dd-16cdb00234c2 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:40:59.496648 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e958ed77-de16-4898-94dd-16cdb00234c2 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:40:59.504836 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e958ed77-de16-4898-94dd-16cdb00234c2 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431" status: 200 len: 1317 microversion: 2.1 time: 0.268656 Dec 15 14:40:59.506005 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1110/2298] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:40:59 2021] GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:41:00.528022 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e01237b0-afc8-4637-9535-c0c116229b91 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:00.529034 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e01237b0-afc8-4637-9535-c0c116229b91 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:00.539967 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e01237b0-afc8-4637-9535-c0c116229b91 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:00.541075 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e01237b0-afc8-4637-9535-c0c116229b91 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:00.542427 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e01237b0-afc8-4637-9535-c0c116229b91 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:00.543163 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e01237b0-afc8-4637-9535-c0c116229b91 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:00.689640 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e01237b0-afc8-4637-9535-c0c116229b91 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:41:00.697409 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e01237b0-afc8-4637-9535-c0c116229b91 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431" status: 200 len: 1317 microversion: 2.1 time: 0.177304 Dec 15 14:41:00.697988 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1189/2299] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:00 2021] GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:41:01.714727 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e532b711-e4d0-49c7-a96e-abe4992f2478 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:01.715333 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e532b711-e4d0-49c7-a96e-abe4992f2478 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:01.721915 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e532b711-e4d0-49c7-a96e-abe4992f2478 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:01.722378 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e532b711-e4d0-49c7-a96e-abe4992f2478 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:01.723162 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e532b711-e4d0-49c7-a96e-abe4992f2478 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:01.723602 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e532b711-e4d0-49c7-a96e-abe4992f2478 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:01.872617 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e532b711-e4d0-49c7-a96e-abe4992f2478 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:41:01.881049 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e532b711-e4d0-49c7-a96e-abe4992f2478 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431" status: 200 len: 1317 microversion: 2.1 time: 0.170073 Dec 15 14:41:01.881755 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1111/2300] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:01 2021] GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:41:02.899354 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ea8c57e4-f68e-447c-98ec-7e788b50cbac tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:02.900138 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ea8c57e4-f68e-447c-98ec-7e788b50cbac tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:02.908095 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea8c57e4-f68e-447c-98ec-7e788b50cbac tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:02.908547 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea8c57e4-f68e-447c-98ec-7e788b50cbac tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:02.909314 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea8c57e4-f68e-447c-98ec-7e788b50cbac tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:02.909783 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea8c57e4-f68e-447c-98ec-7e788b50cbac tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:03.028660 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-d9a5d7b3-cc47-4170-b8ea-08d3d65bb462 req-24e49992-e717-40a3-b674-e0bb09758910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2644eb-81de-42cf-b256-2ac784433431", "name": "network-vif-plugged", "status": "completed", "tag": "56ebdc0e-d1a6-4e19-94f0-3fb635321186"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:41:03.030963 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:41:03.030963 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:41:03.039699 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-d9a5d7b3-cc47-4170-b8ea-08d3d65bb462 req-24e49992-e717-40a3-b674-e0bb09758910 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:03.040213 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-d9a5d7b3-cc47-4170-b8ea-08d3d65bb462 req-24e49992-e717-40a3-b674-e0bb09758910 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:03.054139 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ea8c57e4-f68e-447c-98ec-7e788b50cbac tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:41:03.058907 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-d9a5d7b3-cc47-4170-b8ea-08d3d65bb462 req-24e49992-e717-40a3-b674-e0bb09758910 service nova] Creating event network-vif-plugged:56ebdc0e-d1a6-4e19-94f0-3fb635321186 for instance 2c2644eb-81de-42cf-b256-2ac784433431 on hv-cinder-82182 Dec 15 14:41:03.062341 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ea8c57e4-f68e-447c-98ec-7e788b50cbac tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431" status: 200 len: 1317 microversion: 2.1 time: 0.166820 Dec 15 14:41:03.063588 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1190/2301] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:02 2021] GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:41:03.064430 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-d9a5d7b3-cc47-4170-b8ea-08d3d65bb462 req-24e49992-e717-40a3-b674-e0bb09758910 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039565 Dec 15 14:41:03.065641 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1112/2302] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:41:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:41:04.080940 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2d731713-8e7b-42c9-8a5c-9e7a0a970e9c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:04.081512 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2d731713-8e7b-42c9-8a5c-9e7a0a970e9c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:04.088234 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d731713-8e7b-42c9-8a5c-9e7a0a970e9c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:04.088687 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d731713-8e7b-42c9-8a5c-9e7a0a970e9c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:04.089460 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d731713-8e7b-42c9-8a5c-9e7a0a970e9c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:04.089915 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d731713-8e7b-42c9-8a5c-9e7a0a970e9c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:04.231307 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2d731713-8e7b-42c9-8a5c-9e7a0a970e9c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:41:04.239555 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2d731713-8e7b-42c9-8a5c-9e7a0a970e9c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431" status: 200 len: 1317 microversion: 2.1 time: 0.163104 Dec 15 14:41:04.240141 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1191/2303] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:04 2021] GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:41:05.258077 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f99009d6-04f6-4d0f-8963-1a2fd6e4b525 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:05.258772 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f99009d6-04f6-4d0f-8963-1a2fd6e4b525 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:05.265586 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f99009d6-04f6-4d0f-8963-1a2fd6e4b525 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:05.266110 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f99009d6-04f6-4d0f-8963-1a2fd6e4b525 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:05.267054 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f99009d6-04f6-4d0f-8963-1a2fd6e4b525 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:05.267518 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f99009d6-04f6-4d0f-8963-1a2fd6e4b525 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:05.425564 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f99009d6-04f6-4d0f-8963-1a2fd6e4b525 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:41:05.433850 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f99009d6-04f6-4d0f-8963-1a2fd6e4b525 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431" status: 200 len: 1507 microversion: 2.1 time: 0.180443 Dec 15 14:41:05.434394 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1113/2304] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:05 2021] GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431 => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:41:06.776460 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4ae184c5-eb30-4be6-a6f5-261911593928 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "daed714d-3139-4787-8229-b7c9c538a7a1"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:41:06.777515 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4ae184c5-eb30-4be6-a6f5-261911593928 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:06.784774 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ae184c5-eb30-4be6-a6f5-261911593928 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:06.785222 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ae184c5-eb30-4be6-a6f5-261911593928 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:06.786060 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ae184c5-eb30-4be6-a6f5-261911593928 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:06.786454 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ae184c5-eb30-4be6-a6f5-261911593928 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:07.067353 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4ae184c5-eb30-4be6-a6f5-261911593928 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "POST /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294602 Dec 15 14:41:07.068071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1192/2305] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Dec 15 14:41:06 2021] POST /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:41:14.711860 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7d07b3e8-16bc-4202-bb24-318fccc2a59f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:14.712426 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7d07b3e8-16bc-4202-bb24-318fccc2a59f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:14.720760 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7d07b3e8-16bc-4202-bb24-318fccc2a59f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:14.721256 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7d07b3e8-16bc-4202-bb24-318fccc2a59f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:14.722348 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7d07b3e8-16bc-4202-bb24-318fccc2a59f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:14.722870 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7d07b3e8-16bc-4202-bb24-318fccc2a59f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:14.811074 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-7d07b3e8-16bc-4202-bb24-318fccc2a59f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lazy-loading 'services' on Instance uuid 2c2644eb-81de-42cf-b256-2ac784433431 {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:41:14.886585 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7d07b3e8-16bc-4202-bb24-318fccc2a59f tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431/os-volume_attachments/daed714d-3139-4787-8229-b7c9c538a7a1" status: 202 len: 0 microversion: 2.1 time: 0.180144 Dec 15 14:41:14.887199 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1114/2306] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Dec 15 14:41:14 2021] DELETE /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431/os-volume_attachments/daed714d-3139-4787-8229-b7c9c538a7a1 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:41:14.897353 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e982dead-88db-4bb9-9f51-94ad60b430b4 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:14.898461 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e982dead-88db-4bb9-9f51-94ad60b430b4 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:14.911317 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e982dead-88db-4bb9-9f51-94ad60b430b4 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:14.911317 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e982dead-88db-4bb9-9f51-94ad60b430b4 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:14.911317 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e982dead-88db-4bb9-9f51-94ad60b430b4 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:14.911317 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e982dead-88db-4bb9-9f51-94ad60b430b4 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:14.942655 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e982dead-88db-4bb9-9f51-94ad60b430b4 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050438 Dec 15 14:41:14.943324 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1193/2307] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Dec 15 14:41:14 2021] GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:41:15.958983 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-db6be186-7189-4cca-b37f-568a50cdc867 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:15.960296 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-db6be186-7189-4cca-b37f-568a50cdc867 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:15.968132 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db6be186-7189-4cca-b37f-568a50cdc867 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:15.968581 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db6be186-7189-4cca-b37f-568a50cdc867 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:15.969385 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db6be186-7189-4cca-b37f-568a50cdc867 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:15.969853 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db6be186-7189-4cca-b37f-568a50cdc867 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:16.002874 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-db6be186-7189-4cca-b37f-568a50cdc867 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049646 Dec 15 14:41:16.003481 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1115/2308] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Dec 15 14:41:15 2021] GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:41:17.217369 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f3914d2f-13c3-402a-a67c-2d87f33209cd tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:17.217939 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f3914d2f-13c3-402a-a67c-2d87f33209cd tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:17.224557 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f3914d2f-13c3-402a-a67c-2d87f33209cd tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:17.225064 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f3914d2f-13c3-402a-a67c-2d87f33209cd tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:17.225816 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f3914d2f-13c3-402a-a67c-2d87f33209cd tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:17.226253 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f3914d2f-13c3-402a-a67c-2d87f33209cd tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:17.253738 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f3914d2f-13c3-402a-a67c-2d87f33209cd tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:41:17.332768 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f3914d2f-13c3-402a-a67c-2d87f33209cd tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431" status: 204 len: 0 microversion: 2.1 time: 0.118900 Dec 15 14:41:17.333414 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1194/2309] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:41:17 2021] DELETE /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:41:17.341749 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-44a26129-4f92-4545-9969-6d885ffd4e6b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:17.342354 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-44a26129-4f92-4545-9969-6d885ffd4e6b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:17.348816 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-44a26129-4f92-4545-9969-6d885ffd4e6b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:17.349267 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-44a26129-4f92-4545-9969-6d885ffd4e6b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:17.350071 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-44a26129-4f92-4545-9969-6d885ffd4e6b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:17.350517 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-44a26129-4f92-4545-9969-6d885ffd4e6b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:17.498425 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-44a26129-4f92-4545-9969-6d885ffd4e6b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:41:17.509479 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-44a26129-4f92-4545-9969-6d885ffd4e6b tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431" status: 200 len: 1513 microversion: 2.1 time: 0.171480 Dec 15 14:41:17.510098 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1116/2310] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:17 2021] GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:41:18.532544 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f1482886-3fd6-4d72-a71d-0965b8c9e86e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:18.533478 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f1482886-3fd6-4d72-a71d-0965b8c9e86e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:18.542901 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1482886-3fd6-4d72-a71d-0965b8c9e86e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:18.543366 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1482886-3fd6-4d72-a71d-0965b8c9e86e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:18.544171 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1482886-3fd6-4d72-a71d-0965b8c9e86e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:18.544608 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1482886-3fd6-4d72-a71d-0965b8c9e86e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:18.694011 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f1482886-3fd6-4d72-a71d-0965b8c9e86e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:41:18.708245 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f1482886-3fd6-4d72-a71d-0965b8c9e86e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431" status: 200 len: 1513 microversion: 2.1 time: 0.182774 Dec 15 14:41:18.709093 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1195/2311] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:18 2021] GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431 => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:41:19.726851 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9ec37a7a-3150-414f-9529-ca5cfcf3cddc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:19.727475 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9ec37a7a-3150-414f-9529-ca5cfcf3cddc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:19.734482 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ec37a7a-3150-414f-9529-ca5cfcf3cddc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:19.734937 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ec37a7a-3150-414f-9529-ca5cfcf3cddc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:19.735753 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ec37a7a-3150-414f-9529-ca5cfcf3cddc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:19.736171 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ec37a7a-3150-414f-9529-ca5cfcf3cddc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:19.991543 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9ec37a7a-3150-414f-9529-ca5cfcf3cddc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:41:20.000261 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9ec37a7a-3150-414f-9529-ca5cfcf3cddc tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431" status: 200 len: 1513 microversion: 2.1 time: 0.277085 Dec 15 14:41:20.000849 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1117/2312] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:19 2021] GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431 => generated 1513 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:41:20.175973 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-8d5952f6-4ec4-4469-8832-29adbdd6b685 req-281bfeb9-fad4-418a-8364-fc6ead2473ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2644eb-81de-42cf-b256-2ac784433431", "name": "network-vif-deleted", "tag": "56ebdc0e-d1a6-4e19-94f0-3fb635321186"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:41:20.177767 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:41:20.177767 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:41:20.196010 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-8d5952f6-4ec4-4469-8832-29adbdd6b685 req-281bfeb9-fad4-418a-8364-fc6ead2473ef service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:20.196559 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-8d5952f6-4ec4-4469-8832-29adbdd6b685 req-281bfeb9-fad4-418a-8364-fc6ead2473ef service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:20.208483 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-8d5952f6-4ec4-4469-8832-29adbdd6b685 req-281bfeb9-fad4-418a-8364-fc6ead2473ef service nova] Creating event network-vif-deleted:56ebdc0e-d1a6-4e19-94f0-3fb635321186 for instance 2c2644eb-81de-42cf-b256-2ac784433431 on hv-cinder-82182 Dec 15 14:41:20.214364 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-8d5952f6-4ec4-4469-8832-29adbdd6b685 req-281bfeb9-fad4-418a-8364-fc6ead2473ef service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042125 Dec 15 14:41:20.215563 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1196/2313] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:41:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:41:21.018357 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-480db700-7ac2-45c8-9d59-84fe2d9192c0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:21.018945 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-480db700-7ac2-45c8-9d59-84fe2d9192c0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 2c2644eb-81de-42cf-b256-2ac784433431] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:21.025657 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-480db700-7ac2-45c8-9d59-84fe2d9192c0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:21.026445 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-480db700-7ac2-45c8-9d59-84fe2d9192c0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:21.027205 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-480db700-7ac2-45c8-9d59-84fe2d9192c0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:21.029654 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-480db700-7ac2-45c8-9d59-84fe2d9192c0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:21.041550 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-480db700-7ac2-45c8-9d59-84fe2d9192c0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] HTTP exception thrown: Instance 2c2644eb-81de-42cf-b256-2ac784433431 could not be found. Dec 15 14:41:21.042450 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-480db700-7ac2-45c8-9d59-84fe2d9192c0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Returning 404 to user: Instance 2c2644eb-81de-42cf-b256-2ac784433431 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:41:21.043249 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-480db700-7ac2-45c8-9d59-84fe2d9192c0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431" status: 404 len: 111 microversion: 2.1 time: 0.028948 Dec 15 14:41:21.043786 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1118/2314] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:21 2021] GET /compute/v2.1/servers/2c2644eb-81de-42cf-b256-2ac784433431 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:41:22.201267 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7194ad76-781c-41ef-9be4-31a98eb3a8a9 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:22.202215 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7194ad76-781c-41ef-9be4-31a98eb3a8a9 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:22.209133 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7194ad76-781c-41ef-9be4-31a98eb3a8a9 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:22.209584 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7194ad76-781c-41ef-9be4-31a98eb3a8a9 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:22.210405 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7194ad76-781c-41ef-9be4-31a98eb3a8a9 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:22.210850 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7194ad76-781c-41ef-9be4-31a98eb3a8a9 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:22.237358 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7194ad76-781c-41ef-9be4-31a98eb3a8a9 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:41:22.320345 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7194ad76-781c-41ef-9be4-31a98eb3a8a9 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "DELETE /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 204 len: 0 microversion: 2.1 time: 0.126606 Dec 15 14:41:22.321201 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1197/2315] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:41:22 2021] DELETE /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:41:22.329490 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-142c9927-7f3f-4895-90bb-abe80de2d44e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:22.330121 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-142c9927-7f3f-4895-90bb-abe80de2d44e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:22.336890 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-142c9927-7f3f-4895-90bb-abe80de2d44e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:22.337349 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-142c9927-7f3f-4895-90bb-abe80de2d44e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:22.338150 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-142c9927-7f3f-4895-90bb-abe80de2d44e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:22.338565 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-142c9927-7f3f-4895-90bb-abe80de2d44e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:22.494184 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-142c9927-7f3f-4895-90bb-abe80de2d44e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:41:22.502174 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-142c9927-7f3f-4895-90bb-abe80de2d44e tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 200 len: 1513 microversion: 2.1 time: 0.176726 Dec 15 14:41:22.502733 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1119/2316] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:22 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:41:23.524608 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5afeeccc-fc3b-4fe1-a62b-8a1ba44648b3 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:23.525812 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5afeeccc-fc3b-4fe1-a62b-8a1ba44648b3 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:23.537111 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5afeeccc-fc3b-4fe1-a62b-8a1ba44648b3 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:23.537977 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5afeeccc-fc3b-4fe1-a62b-8a1ba44648b3 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:23.539279 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5afeeccc-fc3b-4fe1-a62b-8a1ba44648b3 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:23.540380 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5afeeccc-fc3b-4fe1-a62b-8a1ba44648b3 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:23.696704 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5afeeccc-fc3b-4fe1-a62b-8a1ba44648b3 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:41:23.705311 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5afeeccc-fc3b-4fe1-a62b-8a1ba44648b3 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 200 len: 1513 microversion: 2.1 time: 0.187678 Dec 15 14:41:23.705989 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1198/2317] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:23 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 1513 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:41:24.722982 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9731c28f-d57c-402c-ada4-6d58e9630dcd tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:24.723680 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9731c28f-d57c-402c-ada4-6d58e9630dcd tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:24.730450 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9731c28f-d57c-402c-ada4-6d58e9630dcd tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:24.730928 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9731c28f-d57c-402c-ada4-6d58e9630dcd tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:24.731715 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9731c28f-d57c-402c-ada4-6d58e9630dcd tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:24.732154 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9731c28f-d57c-402c-ada4-6d58e9630dcd tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:24.955420 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9731c28f-d57c-402c-ada4-6d58e9630dcd tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:41:24.963520 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9731c28f-d57c-402c-ada4-6d58e9630dcd tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 200 len: 1513 microversion: 2.1 time: 0.244297 Dec 15 14:41:24.964107 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1120/2318] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:24 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 1513 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:41:25.106817 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-8fb39a2f-d09b-4d78-86c1-8550091fe6c0 req-a7612951-df9c-4961-a124-068b616896b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c56b0a-393b-4606-a1a7-577c7c9a0203", "name": "network-vif-deleted", "tag": "316b175d-86ab-436b-95bc-a8e21ac1b3bd"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:41:25.108810 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:41:25.108810 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:41:25.116783 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-8fb39a2f-d09b-4d78-86c1-8550091fe6c0 req-a7612951-df9c-4961-a124-068b616896b9 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:25.117227 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-8fb39a2f-d09b-4d78-86c1-8550091fe6c0 req-a7612951-df9c-4961-a124-068b616896b9 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:25.129904 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-8fb39a2f-d09b-4d78-86c1-8550091fe6c0 req-a7612951-df9c-4961-a124-068b616896b9 service nova] Creating event network-vif-deleted:316b175d-86ab-436b-95bc-a8e21ac1b3bd for instance 80c56b0a-393b-4606-a1a7-577c7c9a0203 on hv-cinder-82182 Dec 15 14:41:25.135030 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-8fb39a2f-d09b-4d78-86c1-8550091fe6c0 req-a7612951-df9c-4961-a124-068b616896b9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031824 Dec 15 14:41:25.136009 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1199/2319] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:41:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:41:25.984669 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0afb654d-72d8-4117-937d-3f0fb139e74d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:25.985666 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0afb654d-72d8-4117-937d-3f0fb139e74d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 80c56b0a-393b-4606-a1a7-577c7c9a0203] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:25.996805 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0afb654d-72d8-4117-937d-3f0fb139e74d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:25.997580 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0afb654d-72d8-4117-937d-3f0fb139e74d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:25.998812 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0afb654d-72d8-4117-937d-3f0fb139e74d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:25.999251 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0afb654d-72d8-4117-937d-3f0fb139e74d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:26.012949 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-0afb654d-72d8-4117-937d-3f0fb139e74d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] HTTP exception thrown: Instance 80c56b0a-393b-4606-a1a7-577c7c9a0203 could not be found. Dec 15 14:41:26.013566 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0afb654d-72d8-4117-937d-3f0fb139e74d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Returning 404 to user: Instance 80c56b0a-393b-4606-a1a7-577c7c9a0203 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:41:26.014538 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0afb654d-72d8-4117-937d-3f0fb139e74d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203" status: 404 len: 111 microversion: 2.1 time: 0.036099 Dec 15 14:41:26.015148 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1121/2320] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:25 2021] GET /compute/v2.1/servers/80c56b0a-393b-4606-a1a7-577c7c9a0203 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:41:26.024162 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d5d59660-9536-444a-8a1f-f61565731641 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:26.024735 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d5d59660-9536-444a-8a1f-f61565731641 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:26.032840 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5d59660-9536-444a-8a1f-f61565731641 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:26.033478 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5d59660-9536-444a-8a1f-f61565731641 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:26.034641 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5d59660-9536-444a-8a1f-f61565731641 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:26.034971 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5d59660-9536-444a-8a1f-f61565731641 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:26.068931 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d5d59660-9536-444a-8a1f-f61565731641 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:41:26.167421 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d5d59660-9536-444a-8a1f-f61565731641 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 204 len: 0 microversion: 2.1 time: 0.147251 Dec 15 14:41:26.168004 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1200/2321] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:41:26 2021] DELETE /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:41:26.176541 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ed5df341-3123-4be7-b872-8c692572487c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:26.177172 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ed5df341-3123-4be7-b872-8c692572487c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:26.183658 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed5df341-3123-4be7-b872-8c692572487c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:26.184110 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed5df341-3123-4be7-b872-8c692572487c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:26.184906 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed5df341-3123-4be7-b872-8c692572487c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:26.185342 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed5df341-3123-4be7-b872-8c692572487c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:26.336244 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ed5df341-3123-4be7-b872-8c692572487c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:41:26.349454 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ed5df341-3123-4be7-b872-8c692572487c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 200 len: 1514 microversion: 2.1 time: 0.176389 Dec 15 14:41:26.350535 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1122/2322] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:26 2021] GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:41:27.372208 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c304105c-ddfb-412c-b963-35f26a8498ff tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:27.377466 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c304105c-ddfb-412c-b963-35f26a8498ff tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:27.389941 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c304105c-ddfb-412c-b963-35f26a8498ff tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:27.392319 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c304105c-ddfb-412c-b963-35f26a8498ff tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:27.393155 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c304105c-ddfb-412c-b963-35f26a8498ff tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:27.393597 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c304105c-ddfb-412c-b963-35f26a8498ff tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:27.547409 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c304105c-ddfb-412c-b963-35f26a8498ff tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:41:27.555232 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c304105c-ddfb-412c-b963-35f26a8498ff tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 200 len: 1514 microversion: 2.1 time: 0.189738 Dec 15 14:41:27.556141 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1201/2323] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:27 2021] GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:41:28.574997 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-60f0126a-2f22-41f4-ac9e-76d7b0df1053 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:28.575889 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-60f0126a-2f22-41f4-ac9e-76d7b0df1053 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:28.584652 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60f0126a-2f22-41f4-ac9e-76d7b0df1053 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:28.585368 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60f0126a-2f22-41f4-ac9e-76d7b0df1053 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:28.586813 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60f0126a-2f22-41f4-ac9e-76d7b0df1053 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:28.587576 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60f0126a-2f22-41f4-ac9e-76d7b0df1053 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:28.623345 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-2c4e6078-419e-4228-9923-b16c1168a3fe req-1ca85b40-0e8c-4b6e-b4ef-a87ccd2f4632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f711acc5-e0cb-4209-83ee-e45d22132dd6", "name": "network-vif-deleted", "tag": "e3bbe0c8-88e9-4081-9568-e5ae49af63c0"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:41:28.629280 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:41:28.629280 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:41:28.650539 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-2c4e6078-419e-4228-9923-b16c1168a3fe req-1ca85b40-0e8c-4b6e-b4ef-a87ccd2f4632 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:28.650981 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-2c4e6078-419e-4228-9923-b16c1168a3fe req-1ca85b40-0e8c-4b6e-b4ef-a87ccd2f4632 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:28.664191 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-2c4e6078-419e-4228-9923-b16c1168a3fe req-1ca85b40-0e8c-4b6e-b4ef-a87ccd2f4632 service nova] Creating event network-vif-deleted:e3bbe0c8-88e9-4081-9568-e5ae49af63c0 for instance f711acc5-e0cb-4209-83ee-e45d22132dd6 on hv-cinder-82182 Dec 15 14:41:28.672145 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-2c4e6078-419e-4228-9923-b16c1168a3fe req-1ca85b40-0e8c-4b6e-b4ef-a87ccd2f4632 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057730 Dec 15 14:41:28.672984 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1202/2324] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:41:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:41:28.678338 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-60f0126a-2f22-41f4-ac9e-76d7b0df1053 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:41:28.685807 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-60f0126a-2f22-41f4-ac9e-76d7b0df1053 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 200 len: 1472 microversion: 2.1 time: 0.114742 Dec 15 14:41:28.686550 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1123/2325] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:28 2021] GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 1472 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:41:29.706154 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3e045300-e16f-4363-8706-0ae99c4ff069 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:29.706867 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3e045300-e16f-4363-8706-0ae99c4ff069 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: f711acc5-e0cb-4209-83ee-e45d22132dd6] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:29.714189 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e045300-e16f-4363-8706-0ae99c4ff069 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:29.714640 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e045300-e16f-4363-8706-0ae99c4ff069 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:29.715429 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e045300-e16f-4363-8706-0ae99c4ff069 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:29.715862 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e045300-e16f-4363-8706-0ae99c4ff069 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:29.729557 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-3e045300-e16f-4363-8706-0ae99c4ff069 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] HTTP exception thrown: Instance f711acc5-e0cb-4209-83ee-e45d22132dd6 could not be found. Dec 15 14:41:29.730181 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3e045300-e16f-4363-8706-0ae99c4ff069 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Returning 404 to user: Instance f711acc5-e0cb-4209-83ee-e45d22132dd6 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:41:29.731013 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3e045300-e16f-4363-8706-0ae99c4ff069 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6" status: 404 len: 111 microversion: 2.1 time: 0.030564 Dec 15 14:41:29.731553 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1203/2326] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:29 2021] GET /compute/v2.1/servers/f711acc5-e0cb-4209-83ee-e45d22132dd6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:41:30.891634 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-51c1bf31-4ba2-4746-b47f-7ef452177b7d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:30.892218 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-51c1bf31-4ba2-4746-b47f-7ef452177b7d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:30.902213 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51c1bf31-4ba2-4746-b47f-7ef452177b7d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:30.902572 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51c1bf31-4ba2-4746-b47f-7ef452177b7d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:30.903348 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51c1bf31-4ba2-4746-b47f-7ef452177b7d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:30.903794 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51c1bf31-4ba2-4746-b47f-7ef452177b7d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:30.936167 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-51c1bf31-4ba2-4746-b47f-7ef452177b7d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:41:31.054408 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-51c1bf31-4ba2-4746-b47f-7ef452177b7d tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c" status: 204 len: 0 microversion: 2.1 time: 0.167555 Dec 15 14:41:31.055034 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1124/2327] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:41:30 2021] DELETE /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:41:31.069296 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1be82044-7043-4282-8f3d-c83a4b9151eb tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:31.070694 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1be82044-7043-4282-8f3d-c83a4b9151eb tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:31.080611 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1be82044-7043-4282-8f3d-c83a4b9151eb tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:31.081195 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1be82044-7043-4282-8f3d-c83a4b9151eb tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:31.082347 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1be82044-7043-4282-8f3d-c83a4b9151eb tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:31.082820 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1be82044-7043-4282-8f3d-c83a4b9151eb tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:31.263549 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1be82044-7043-4282-8f3d-c83a4b9151eb tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:41:31.272238 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1be82044-7043-4282-8f3d-c83a4b9151eb tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c" status: 200 len: 1513 microversion: 2.1 time: 0.208773 Dec 15 14:41:31.272833 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1204/2328] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:31 2021] GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c => generated 1513 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:41:32.297067 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-723b7ff8-c27d-4c5f-b692-030404a27a5c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:32.297794 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-723b7ff8-c27d-4c5f-b692-030404a27a5c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:32.305085 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-723b7ff8-c27d-4c5f-b692-030404a27a5c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:32.305550 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-723b7ff8-c27d-4c5f-b692-030404a27a5c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:32.306379 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-723b7ff8-c27d-4c5f-b692-030404a27a5c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:32.306794 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-723b7ff8-c27d-4c5f-b692-030404a27a5c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:32.451684 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-723b7ff8-c27d-4c5f-b692-030404a27a5c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:41:32.459873 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-723b7ff8-c27d-4c5f-b692-030404a27a5c tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c" status: 200 len: 1513 microversion: 2.1 time: 0.166889 Dec 15 14:41:32.460477 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1125/2329] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:32 2021] GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:41:33.477852 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-83728169-8d6d-4df0-af53-e5aff03b5690 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:33.478461 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-83728169-8d6d-4df0-af53-e5aff03b5690 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:33.485547 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83728169-8d6d-4df0-af53-e5aff03b5690 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:33.486005 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83728169-8d6d-4df0-af53-e5aff03b5690 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:33.486869 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83728169-8d6d-4df0-af53-e5aff03b5690 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:33.487376 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83728169-8d6d-4df0-af53-e5aff03b5690 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:33.887009 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-83728169-8d6d-4df0-af53-e5aff03b5690 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7378b95dd546ef9572852a4139fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225b5a61fee14f748a30f2030266c65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:41:33.896143 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-83728169-8d6d-4df0-af53-e5aff03b5690 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c" status: 200 len: 1513 microversion: 2.1 time: 0.422267 Dec 15 14:41:33.896725 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1205/2330] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:33 2021] GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c => generated 1513 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:41:34.054710 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-61b6224e-b7f7-4498-803b-f19764315cde req-c7b71d30-2784-4160-aa3c-c9953ed5f713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d171d12-9846-4408-8e30-94c02021b71c", "name": "network-vif-deleted", "tag": "f76cd51a-cd97-48dc-b62c-2df3238be180"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:41:34.057002 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:41:34.057002 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:41:34.064468 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-61b6224e-b7f7-4498-803b-f19764315cde req-c7b71d30-2784-4160-aa3c-c9953ed5f713 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:34.064906 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-61b6224e-b7f7-4498-803b-f19764315cde req-c7b71d30-2784-4160-aa3c-c9953ed5f713 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:34.076341 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-61b6224e-b7f7-4498-803b-f19764315cde req-c7b71d30-2784-4160-aa3c-c9953ed5f713 service nova] Creating event network-vif-deleted:f76cd51a-cd97-48dc-b62c-2df3238be180 for instance 1d171d12-9846-4408-8e30-94c02021b71c on hv-cinder-82182 Dec 15 14:41:34.081898 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-61b6224e-b7f7-4498-803b-f19764315cde req-c7b71d30-2784-4160-aa3c-c9953ed5f713 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030777 Dec 15 14:41:34.082551 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1126/2331] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:41:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:41:34.916436 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fb9acdab-9989-49b5-9c46-be6ba6d640d0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:41:34.917029 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fb9acdab-9989-49b5-9c46-be6ba6d640d0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] [instance: 1d171d12-9846-4408-8e30-94c02021b71c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:41:34.925601 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb9acdab-9989-49b5-9c46-be6ba6d640d0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:34.926305 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb9acdab-9989-49b5-9c46-be6ba6d640d0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:34.927485 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb9acdab-9989-49b5-9c46-be6ba6d640d0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:41:34.928184 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb9acdab-9989-49b5-9c46-be6ba6d640d0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:41:34.946551 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-fb9acdab-9989-49b5-9c46-be6ba6d640d0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] HTTP exception thrown: Instance 1d171d12-9846-4408-8e30-94c02021b71c could not be found. Dec 15 14:41:34.947158 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fb9acdab-9989-49b5-9c46-be6ba6d640d0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] Returning 404 to user: Instance 1d171d12-9846-4408-8e30-94c02021b71c could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:41:34.948001 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fb9acdab-9989-49b5-9c46-be6ba6d640d0 tempest-AttachVolumeNegativeTest-1955580569 tempest-AttachVolumeNegativeTest-1955580569-project] 10.222.0.42 "GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c" status: 404 len: 111 microversion: 2.1 time: 0.036843 Dec 15 14:41:34.948564 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1206/2332] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:41:34 2021] GET /compute/v2.1/servers/1d171d12-9846-4408-8e30-94c02021b71c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:43:17.515265 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1eb6c985-6e3b-41ea-bf3f-1f0e325e952d tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:17.515865 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1eb6c985-6e3b-41ea-bf3f-1f0e325e952d tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:17.522765 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1eb6c985-6e3b-41ea-bf3f-1f0e325e952d tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:17.523219 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1eb6c985-6e3b-41ea-bf3f-1f0e325e952d tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:17.524009 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1eb6c985-6e3b-41ea-bf3f-1f0e325e952d tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:17.524424 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1eb6c985-6e3b-41ea-bf3f-1f0e325e952d tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:17.554086 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1eb6c985-6e3b-41ea-bf3f-1f0e325e952d tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:43:17.634929 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1eb6c985-6e3b-41ea-bf3f-1f0e325e952d tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 204 len: 0 microversion: 2.1 time: 0.126205 Dec 15 14:43:17.635506 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1127/2333] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:43:17 2021] DELETE /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:43:17.644789 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-237d5fb1-39e4-4df2-b608-60ea5c39ccd7 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:17.646037 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-237d5fb1-39e4-4df2-b608-60ea5c39ccd7 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:17.653201 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-237d5fb1-39e4-4df2-b608-60ea5c39ccd7 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:17.653674 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-237d5fb1-39e4-4df2-b608-60ea5c39ccd7 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:17.654459 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-237d5fb1-39e4-4df2-b608-60ea5c39ccd7 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:17.654895 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-237d5fb1-39e4-4df2-b608-60ea5c39ccd7 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:17.797990 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-237d5fb1-39e4-4df2-b608-60ea5c39ccd7 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:17.805203 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-237d5fb1-39e4-4df2-b608-60ea5c39ccd7 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1574 microversion: 2.1 time: 0.165109 Dec 15 14:43:17.806472 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1207/2334] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:17 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:43:18.824460 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-651c3dd5-1929-4536-ba5e-bacd77a30975 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:18.825158 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-651c3dd5-1929-4536-ba5e-bacd77a30975 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:18.832032 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-651c3dd5-1929-4536-ba5e-bacd77a30975 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:18.832482 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-651c3dd5-1929-4536-ba5e-bacd77a30975 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:18.833271 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-651c3dd5-1929-4536-ba5e-bacd77a30975 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:18.833744 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-651c3dd5-1929-4536-ba5e-bacd77a30975 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:18.981098 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-651c3dd5-1929-4536-ba5e-bacd77a30975 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:18.989155 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-651c3dd5-1929-4536-ba5e-bacd77a30975 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1574 microversion: 2.1 time: 0.169061 Dec 15 14:43:18.989774 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1128/2335] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:18 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:43:20.013537 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7e9a6507-c5d0-416c-8295-49239c4121db tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:20.015052 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7e9a6507-c5d0-416c-8295-49239c4121db tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:20.023573 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e9a6507-c5d0-416c-8295-49239c4121db tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:20.024027 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e9a6507-c5d0-416c-8295-49239c4121db tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:20.024818 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e9a6507-c5d0-416c-8295-49239c4121db tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:20.025464 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e9a6507-c5d0-416c-8295-49239c4121db tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:20.312024 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7e9a6507-c5d0-416c-8295-49239c4121db tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:20.321834 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7e9a6507-c5d0-416c-8295-49239c4121db tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1574 microversion: 2.1 time: 0.316993 Dec 15 14:43:20.322698 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1208/2336] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:20 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1574 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:43:20.856728 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-e0692bc9-9f72-49f6-a3e5-2bede9350489 req-94e4b4e4-07cf-498a-b41d-1f6993e5d3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8115b3e6-ac36-405e-a868-eea90e723391", "name": "network-vif-deleted", "tag": "a3a04721-267d-4263-ba76-a6af16c811e2"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:43:20.859001 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:43:20.859001 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:43:20.866795 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-e0692bc9-9f72-49f6-a3e5-2bede9350489 req-94e4b4e4-07cf-498a-b41d-1f6993e5d3c6 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:20.867233 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-e0692bc9-9f72-49f6-a3e5-2bede9350489 req-94e4b4e4-07cf-498a-b41d-1f6993e5d3c6 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:20.878882 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-e0692bc9-9f72-49f6-a3e5-2bede9350489 req-94e4b4e4-07cf-498a-b41d-1f6993e5d3c6 service nova] Creating event network-vif-deleted:a3a04721-267d-4263-ba76-a6af16c811e2 for instance 8115b3e6-ac36-405e-a868-eea90e723391 on hv-cinder-82182 Dec 15 14:43:20.884255 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-e0692bc9-9f72-49f6-a3e5-2bede9350489 req-94e4b4e4-07cf-498a-b41d-1f6993e5d3c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031435 Dec 15 14:43:20.888029 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1129/2337] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:43:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:43:21.340955 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e8307832-7fa7-4cbc-ba0e-d89d6b8c42e5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:21.341574 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e8307832-7fa7-4cbc-ba0e-d89d6b8c42e5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:21.348517 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8307832-7fa7-4cbc-ba0e-d89d6b8c42e5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:21.348940 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8307832-7fa7-4cbc-ba0e-d89d6b8c42e5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:21.349767 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8307832-7fa7-4cbc-ba0e-d89d6b8c42e5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:21.350185 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8307832-7fa7-4cbc-ba0e-d89d6b8c42e5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:21.383626 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8307832-7fa7-4cbc-ba0e-d89d6b8c42e5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:21.384051 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8307832-7fa7-4cbc-ba0e-d89d6b8c42e5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:21.384569 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-e8307832-7fa7-4cbc-ba0e-d89d6b8c42e5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lazy-loading 'fault' on Instance uuid 8115b3e6-ac36-405e-a868-eea90e723391 {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:43:21.427820 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e8307832-7fa7-4cbc-ba0e-d89d6b8c42e5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:21.436015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e8307832-7fa7-4cbc-ba0e-d89d6b8c42e5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 200 len: 1229 microversion: 2.1 time: 0.098827 Dec 15 14:43:21.436586 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1209/2338] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:21 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:43:22.454571 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5fac2b8a-4cb7-4f23-853c-2b5a61083cd0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:22.455217 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5fac2b8a-4cb7-4f23-853c-2b5a61083cd0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:22.464527 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fac2b8a-4cb7-4f23-853c-2b5a61083cd0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:22.464979 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fac2b8a-4cb7-4f23-853c-2b5a61083cd0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:22.465822 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fac2b8a-4cb7-4f23-853c-2b5a61083cd0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:22.466300 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fac2b8a-4cb7-4f23-853c-2b5a61083cd0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:22.482939 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-5fac2b8a-4cb7-4f23-853c-2b5a61083cd0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] HTTP exception thrown: Instance 8115b3e6-ac36-405e-a868-eea90e723391 could not be found. Dec 15 14:43:22.483531 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5fac2b8a-4cb7-4f23-853c-2b5a61083cd0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Returning 404 to user: Instance 8115b3e6-ac36-405e-a868-eea90e723391 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:43:22.484404 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5fac2b8a-4cb7-4f23-853c-2b5a61083cd0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 404 len: 111 microversion: 2.1 time: 0.034562 Dec 15 14:43:22.484976 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1130/2339] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:22 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:43:22.584488 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f7c0d463-dace-4f6c-aae9-0494daed6986 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1712314717", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-567869390", "security_groups": [{"name": "tempest-secgroup-smoke-88561615"}], "block_device_mapping_v2": [{"uuid": "fc9d7e0c-5a68-47f3-9d0e-ea54c7330dd8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d33d9d6-f65d-49df-b4e4-2047aa765843"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:43:22.706500 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-f7c0d463-dace-4f6c-aae9-0494daed6986 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] validate_networks() for [('8d33d9d6-f65d-49df-b4e4-2047aa765843', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:43:22.954335 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:43:22.954580 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:43:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Dec 15 14:43:23.104663 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-f7c0d463-dace-4f6c-aae9-0494daed6986 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:43:23.105086 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-f7c0d463-dace-4f6c-aae9-0494daed6986 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:43:23.105553 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-f7c0d463-dace-4f6c-aae9-0494daed6986 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:43:23.106003 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-f7c0d463-dace-4f6c-aae9-0494daed6986 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:43:23.106402 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-f7c0d463-dace-4f6c-aae9-0494daed6986 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:43:23.115180 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f7c0d463-dace-4f6c-aae9-0494daed6986 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:23.115624 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f7c0d463-dace-4f6c-aae9-0494daed6986 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:23.116416 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f7c0d463-dace-4f6c-aae9-0494daed6986 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:23.116844 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f7c0d463-dace-4f6c-aae9-0494daed6986 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:23.133748 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-f7c0d463-dace-4f6c-aae9-0494daed6986 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Getting quotas for project 8c64dae61ceb4d9280a759bf3f111c80. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:43:23.137903 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-f7c0d463-dace-4f6c-aae9-0494daed6986 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Getting quotas for user 192b688b02c6455dbc4cdb22e7023521 and project 8c64dae61ceb4d9280a759bf3f111c80. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:43:23.201812 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f7c0d463-dace-4f6c-aae9-0494daed6986 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:43:23.204227 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f7c0d463-dace-4f6c-aae9-0494daed6986 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fc9d7e0c-5a68-47f3-9d0e-ea54c7330dd8',volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:43:23.343180 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f7c0d463-dace-4f6c-aae9-0494daed6986 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.762260 Dec 15 14:43:23.344014 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1210/2340] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Dec 15 14:43:22 2021] POST /compute/v2.1/servers => generated 404 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:43:23.353849 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a3ace88c-dc2c-4a22-b6c0-fbc7aea93408 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:23.354470 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a3ace88c-dc2c-4a22-b6c0-fbc7aea93408 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:23.409710 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a3ace88c-dc2c-4a22-b6c0-fbc7aea93408 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:23.416814 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a3ace88c-dc2c-4a22-b6c0-fbc7aea93408 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1094 microversion: 2.1 time: 0.066764 Dec 15 14:43:23.417558 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1131/2341] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:23 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:43:24.435197 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-848daac1-9f25-42d2-9136-23cbaa9c4250 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:24.435913 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-848daac1-9f25-42d2-9136-23cbaa9c4250 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:24.494462 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-848daac1-9f25-42d2-9136-23cbaa9c4250 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:24.502513 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-848daac1-9f25-42d2-9136-23cbaa9c4250 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1094 microversion: 2.1 time: 0.072182 Dec 15 14:43:24.503091 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1211/2342] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:24 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:43:25.520242 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f048aa6e-9149-434f-9bbe-a3e1d2269718 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:25.520837 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f048aa6e-9149-434f-9bbe-a3e1d2269718 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:25.527478 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f048aa6e-9149-434f-9bbe-a3e1d2269718 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:25.527936 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f048aa6e-9149-434f-9bbe-a3e1d2269718 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:25.528714 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f048aa6e-9149-434f-9bbe-a3e1d2269718 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:25.529153 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f048aa6e-9149-434f-9bbe-a3e1d2269718 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:25.594010 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f048aa6e-9149-434f-9bbe-a3e1d2269718 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:25.603846 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f048aa6e-9149-434f-9bbe-a3e1d2269718 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1144 microversion: 2.1 time: 0.087191 Dec 15 14:43:25.604769 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1132/2343] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:25 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:43:26.624712 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a7cedd7e-bf32-4506-8399-97bca9a41fc6 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:26.625414 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a7cedd7e-bf32-4506-8399-97bca9a41fc6 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:26.633028 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7cedd7e-bf32-4506-8399-97bca9a41fc6 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:26.633488 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7cedd7e-bf32-4506-8399-97bca9a41fc6 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:26.634442 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7cedd7e-bf32-4506-8399-97bca9a41fc6 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:26.634873 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7cedd7e-bf32-4506-8399-97bca9a41fc6 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:26.703235 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a7cedd7e-bf32-4506-8399-97bca9a41fc6 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:26.711574 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a7cedd7e-bf32-4506-8399-97bca9a41fc6 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1210 microversion: 2.1 time: 0.090766 Dec 15 14:43:26.712219 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1212/2344] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:26 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:43:27.729746 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7fe912ad-deae-4c07-88c5-4539f6e33cdd tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:27.730331 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7fe912ad-deae-4c07-88c5-4539f6e33cdd tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:27.736572 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fe912ad-deae-4c07-88c5-4539f6e33cdd tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:27.737030 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fe912ad-deae-4c07-88c5-4539f6e33cdd tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:27.737868 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fe912ad-deae-4c07-88c5-4539f6e33cdd tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:27.738307 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fe912ad-deae-4c07-88c5-4539f6e33cdd tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:27.999334 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7fe912ad-deae-4c07-88c5-4539f6e33cdd tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:28.018060 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7fe912ad-deae-4c07-88c5-4539f6e33cdd tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1264 microversion: 2.1 time: 0.293153 Dec 15 14:43:28.028632 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1133/2345] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:27 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1264 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:43:28.247036 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-15de8460-82d4-4b6e-891a-b8a2d9fb9ddf req-37eec961-abc5-407e-bb3c-0cb18468a4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48676f0f-3fe3-4e9f-a5ba-4225782ebbb3", "tag": "6dfdb681-f711-44d8-a4f8-8926272320ac"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:43:28.249296 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:43:28.249296 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:43:28.258121 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-15de8460-82d4-4b6e-891a-b8a2d9fb9ddf req-37eec961-abc5-407e-bb3c-0cb18468a4b0 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:28.260060 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-15de8460-82d4-4b6e-891a-b8a2d9fb9ddf req-37eec961-abc5-407e-bb3c-0cb18468a4b0 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:28.282245 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-15de8460-82d4-4b6e-891a-b8a2d9fb9ddf req-37eec961-abc5-407e-bb3c-0cb18468a4b0 service nova] Creating event network-changed:6dfdb681-f711-44d8-a4f8-8926272320ac for instance 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 on hv-cinder-82182 Dec 15 14:43:28.288549 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-15de8460-82d4-4b6e-891a-b8a2d9fb9ddf req-37eec961-abc5-407e-bb3c-0cb18468a4b0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046786 Dec 15 14:43:28.289190 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1213/2346] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:43:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:43:29.036253 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5045f70b-5f7d-4d0c-a4e7-dcbd71b2e879 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:29.036986 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5045f70b-5f7d-4d0c-a4e7-dcbd71b2e879 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:29.044568 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5045f70b-5f7d-4d0c-a4e7-dcbd71b2e879 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:29.044956 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5045f70b-5f7d-4d0c-a4e7-dcbd71b2e879 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:29.045854 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5045f70b-5f7d-4d0c-a4e7-dcbd71b2e879 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:29.046309 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5045f70b-5f7d-4d0c-a4e7-dcbd71b2e879 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:29.326546 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5045f70b-5f7d-4d0c-a4e7-dcbd71b2e879 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:29.336907 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5045f70b-5f7d-4d0c-a4e7-dcbd71b2e879 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1264 microversion: 2.1 time: 0.304700 Dec 15 14:43:29.337556 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1134/2347] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:29 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1264 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:43:29.604650 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:43:29.604865 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:43:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:43:30.359570 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6c5c5617-c1e4-4479-b8a9-6c7ab0be1239 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:30.360278 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6c5c5617-c1e4-4479-b8a9-6c7ab0be1239 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:30.369598 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c5c5617-c1e4-4479-b8a9-6c7ab0be1239 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:30.370096 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c5c5617-c1e4-4479-b8a9-6c7ab0be1239 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:30.370858 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c5c5617-c1e4-4479-b8a9-6c7ab0be1239 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:30.371303 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c5c5617-c1e4-4479-b8a9-6c7ab0be1239 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:30.519756 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6c5c5617-c1e4-4479-b8a9-6c7ab0be1239 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:30.527488 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6c5c5617-c1e4-4479-b8a9-6c7ab0be1239 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1264 microversion: 2.1 time: 0.175201 Dec 15 14:43:30.528122 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1214/2348] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:30 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:43:31.188190 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:43:31.188780 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:43:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:43:31.545273 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-eb8ffc52-ea40-4eb0-bb61-e5cf39a1ee35 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:31.546121 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-eb8ffc52-ea40-4eb0-bb61-e5cf39a1ee35 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:31.553073 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb8ffc52-ea40-4eb0-bb61-e5cf39a1ee35 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:31.553524 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb8ffc52-ea40-4eb0-bb61-e5cf39a1ee35 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:31.554381 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb8ffc52-ea40-4eb0-bb61-e5cf39a1ee35 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:31.554832 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb8ffc52-ea40-4eb0-bb61-e5cf39a1ee35 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:31.699805 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-eb8ffc52-ea40-4eb0-bb61-e5cf39a1ee35 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:31.707439 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-eb8ffc52-ea40-4eb0-bb61-e5cf39a1ee35 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1264 microversion: 2.1 time: 0.166031 Dec 15 14:43:31.708240 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1135/2349] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:31 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:43:32.725284 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bc572d92-7e5f-4cf6-8fad-d15c4bde3276 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:32.725931 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bc572d92-7e5f-4cf6-8fad-d15c4bde3276 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:32.732993 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bc572d92-7e5f-4cf6-8fad-d15c4bde3276 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:32.733640 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bc572d92-7e5f-4cf6-8fad-d15c4bde3276 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:32.735527 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bc572d92-7e5f-4cf6-8fad-d15c4bde3276 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:32.735955 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bc572d92-7e5f-4cf6-8fad-d15c4bde3276 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:32.904069 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bc572d92-7e5f-4cf6-8fad-d15c4bde3276 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:32.913499 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bc572d92-7e5f-4cf6-8fad-d15c4bde3276 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1264 microversion: 2.1 time: 0.192155 Dec 15 14:43:32.914190 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1215/2350] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:32 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:43:33.934558 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c8aec5d3-dfda-45c3-bc8e-ba6762f317d3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:33.935191 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c8aec5d3-dfda-45c3-bc8e-ba6762f317d3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:33.944549 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8aec5d3-dfda-45c3-bc8e-ba6762f317d3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:33.945241 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8aec5d3-dfda-45c3-bc8e-ba6762f317d3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:33.946602 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8aec5d3-dfda-45c3-bc8e-ba6762f317d3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:33.947045 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8aec5d3-dfda-45c3-bc8e-ba6762f317d3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:34.278102 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c8aec5d3-dfda-45c3-bc8e-ba6762f317d3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:34.286479 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c8aec5d3-dfda-45c3-bc8e-ba6762f317d3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1264 microversion: 2.1 time: 0.358438 Dec 15 14:43:34.287045 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1136/2351] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:33 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1264 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:43:35.305802 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-039b8352-a263-4bd1-96e0-fc31641a21ba tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:35.306809 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-039b8352-a263-4bd1-96e0-fc31641a21ba tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:35.320494 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-039b8352-a263-4bd1-96e0-fc31641a21ba tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:35.321071 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-039b8352-a263-4bd1-96e0-fc31641a21ba tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:35.322464 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-039b8352-a263-4bd1-96e0-fc31641a21ba tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:35.322908 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-039b8352-a263-4bd1-96e0-fc31641a21ba tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:35.529918 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-039b8352-a263-4bd1-96e0-fc31641a21ba tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:35.537936 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-039b8352-a263-4bd1-96e0-fc31641a21ba tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1264 microversion: 2.1 time: 0.236021 Dec 15 14:43:35.538636 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1216/2352] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:35 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1264 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:43:36.555842 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f07b526f-4d93-4a30-b587-82f2e4475aa7 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:36.556502 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f07b526f-4d93-4a30-b587-82f2e4475aa7 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:36.563377 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f07b526f-4d93-4a30-b587-82f2e4475aa7 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:36.563831 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f07b526f-4d93-4a30-b587-82f2e4475aa7 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:36.564638 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f07b526f-4d93-4a30-b587-82f2e4475aa7 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:36.565078 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f07b526f-4d93-4a30-b587-82f2e4475aa7 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:36.723625 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f07b526f-4d93-4a30-b587-82f2e4475aa7 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:36.731784 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f07b526f-4d93-4a30-b587-82f2e4475aa7 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1264 microversion: 2.1 time: 0.179833 Dec 15 14:43:36.732391 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1137/2353] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:36 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:43:37.749425 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f37c8e6c-962a-46b2-abbe-f24192fb7bf3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:37.750035 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f37c8e6c-962a-46b2-abbe-f24192fb7bf3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:37.756877 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f37c8e6c-962a-46b2-abbe-f24192fb7bf3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:37.757329 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f37c8e6c-962a-46b2-abbe-f24192fb7bf3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:37.758260 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f37c8e6c-962a-46b2-abbe-f24192fb7bf3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:37.758775 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f37c8e6c-962a-46b2-abbe-f24192fb7bf3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:37.903796 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f37c8e6c-962a-46b2-abbe-f24192fb7bf3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:37.911802 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f37c8e6c-962a-46b2-abbe-f24192fb7bf3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1264 microversion: 2.1 time: 0.166274 Dec 15 14:43:37.912390 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1217/2354] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:37 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:43:38.928607 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-63a53f2f-2b2f-44fa-b6ac-78eae1cb5c53 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:38.929187 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-63a53f2f-2b2f-44fa-b6ac-78eae1cb5c53 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:38.936234 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63a53f2f-2b2f-44fa-b6ac-78eae1cb5c53 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:38.936674 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63a53f2f-2b2f-44fa-b6ac-78eae1cb5c53 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:38.937456 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63a53f2f-2b2f-44fa-b6ac-78eae1cb5c53 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:38.937948 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63a53f2f-2b2f-44fa-b6ac-78eae1cb5c53 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:39.080519 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-63a53f2f-2b2f-44fa-b6ac-78eae1cb5c53 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:39.088344 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-63a53f2f-2b2f-44fa-b6ac-78eae1cb5c53 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1264 microversion: 2.1 time: 0.163471 Dec 15 14:43:39.088885 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1138/2355] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:38 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:43:39.776915 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-3eb17d68-b171-49ce-9663-e307acae7359 req-c906f731-9e36-4589-8be9-8551476d930a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48676f0f-3fe3-4e9f-a5ba-4225782ebbb3", "name": "network-vif-plugged", "status": "completed", "tag": "6dfdb681-f711-44d8-a4f8-8926272320ac"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:43:39.778883 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:43:39.778883 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:43:39.787270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-3eb17d68-b171-49ce-9663-e307acae7359 req-c906f731-9e36-4589-8be9-8551476d930a service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:39.787829 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-3eb17d68-b171-49ce-9663-e307acae7359 req-c906f731-9e36-4589-8be9-8551476d930a service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:39.800366 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-3eb17d68-b171-49ce-9663-e307acae7359 req-c906f731-9e36-4589-8be9-8551476d930a service nova] Creating event network-vif-plugged:6dfdb681-f711-44d8-a4f8-8926272320ac for instance 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 on hv-cinder-82182 Dec 15 14:43:39.805669 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-3eb17d68-b171-49ce-9663-e307acae7359 req-c906f731-9e36-4589-8be9-8551476d930a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032827 Dec 15 14:43:39.806516 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1218/2356] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:43:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:43:40.107241 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-15de3dce-c8db-4ddf-8731-888e561e51f3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:40.107777 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-15de3dce-c8db-4ddf-8731-888e561e51f3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:40.114612 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15de3dce-c8db-4ddf-8731-888e561e51f3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:40.115073 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15de3dce-c8db-4ddf-8731-888e561e51f3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:40.115918 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15de3dce-c8db-4ddf-8731-888e561e51f3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:40.116337 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15de3dce-c8db-4ddf-8731-888e561e51f3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:40.251140 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-15de3dce-c8db-4ddf-8731-888e561e51f3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:40.259438 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-15de3dce-c8db-4ddf-8731-888e561e51f3 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1264 microversion: 2.1 time: 0.156381 Dec 15 14:43:40.260014 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1139/2357] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:40 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:43:41.280584 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7468239f-4c45-4bc2-b8fc-7040c6060a73 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:41.281302 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7468239f-4c45-4bc2-b8fc-7040c6060a73 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:41.291623 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7468239f-4c45-4bc2-b8fc-7040c6060a73 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:41.292070 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7468239f-4c45-4bc2-b8fc-7040c6060a73 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:41.292842 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7468239f-4c45-4bc2-b8fc-7040c6060a73 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:41.293276 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7468239f-4c45-4bc2-b8fc-7040c6060a73 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:41.452880 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7468239f-4c45-4bc2-b8fc-7040c6060a73 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:41.461528 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7468239f-4c45-4bc2-b8fc-7040c6060a73 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1264 microversion: 2.1 time: 0.186824 Dec 15 14:43:41.462233 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1219/2358] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:41 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:43:42.483690 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7ab54cc7-0916-43dd-b4ac-8da523fcb774 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:42.484632 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7ab54cc7-0916-43dd-b4ac-8da523fcb774 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:42.495763 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ab54cc7-0916-43dd-b4ac-8da523fcb774 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:42.496141 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ab54cc7-0916-43dd-b4ac-8da523fcb774 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:42.496944 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ab54cc7-0916-43dd-b4ac-8da523fcb774 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:42.497381 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ab54cc7-0916-43dd-b4ac-8da523fcb774 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:42.638764 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7ab54cc7-0916-43dd-b4ac-8da523fcb774 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:42.646644 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7ab54cc7-0916-43dd-b4ac-8da523fcb774 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1450 microversion: 2.1 time: 0.170124 Dec 15 14:43:42.647234 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1140/2359] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:42 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1450 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:43:42.663292 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-297f3ea2-9033-42a8-bf18-4cbd52957f6f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:43:42.663861 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-297f3ea2-9033-42a8-bf18-4cbd52957f6f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:43:42.670565 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-297f3ea2-9033-42a8-bf18-4cbd52957f6f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:42.671027 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-297f3ea2-9033-42a8-bf18-4cbd52957f6f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:42.671820 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-297f3ea2-9033-42a8-bf18-4cbd52957f6f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:42.672270 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-297f3ea2-9033-42a8-bf18-4cbd52957f6f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:42.814197 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-297f3ea2-9033-42a8-bf18-4cbd52957f6f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:43:42.822750 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-297f3ea2-9033-42a8-bf18-4cbd52957f6f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1450 microversion: 2.1 time: 0.163486 Dec 15 14:43:42.823519 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1220/2360] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:43:42 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:43:44.558764 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-2bce0e02-4329-401c-92ac-f153bb4bfcf9 req-3aec9d3e-cbca-4ccc-a3ac-6dbe15b71cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48676f0f-3fe3-4e9f-a5ba-4225782ebbb3", "tag": "6dfdb681-f711-44d8-a4f8-8926272320ac"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:43:44.560412 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:43:44.560412 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:43:44.573655 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-2bce0e02-4329-401c-92ac-f153bb4bfcf9 req-3aec9d3e-cbca-4ccc-a3ac-6dbe15b71cb3 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:43:44.574359 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-2bce0e02-4329-401c-92ac-f153bb4bfcf9 req-3aec9d3e-cbca-4ccc-a3ac-6dbe15b71cb3 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:43:44.588764 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-2bce0e02-4329-401c-92ac-f153bb4bfcf9 req-3aec9d3e-cbca-4ccc-a3ac-6dbe15b71cb3 service nova] Creating event network-changed:6dfdb681-f711-44d8-a4f8-8926272320ac for instance 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 on hv-cinder-82182 Dec 15 14:43:44.594133 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-2bce0e02-4329-401c-92ac-f153bb4bfcf9 req-3aec9d3e-cbca-4ccc-a3ac-6dbe15b71cb3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039431 Dec 15 14:43:44.595014 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1141/2361] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:43:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:45:09.159761 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:45:09.160419 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:45:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:46:00.956920 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: ERROR oslo.messaging._drivers.impl_rabbit [-] [95a38445-d847-45c9-bd16-30efac0beb8d] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 15 14:46:00.962103 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-41187217-87df-4d9b-87e7-08cf94601a74 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-237016849", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-567869390", "security_groups": [{"name": "tempest-secgroup-smoke-88561615"}], "block_device_mapping_v2": [{"uuid": "d4ef5645-7a09-4eed-8c58-549891c3c551", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d33d9d6-f65d-49df-b4e4-2047aa765843"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:46:01.087091 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-41187217-87df-4d9b-87e7-08cf94601a74 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] validate_networks() for [('8d33d9d6-f65d-49df-b4e4-2047aa765843', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:46:01.549546 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-41187217-87df-4d9b-87e7-08cf94601a74 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:46:01.550015 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-41187217-87df-4d9b-87e7-08cf94601a74 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:46:01.550496 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-41187217-87df-4d9b-87e7-08cf94601a74 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:46:01.550907 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-41187217-87df-4d9b-87e7-08cf94601a74 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:46:01.551324 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-41187217-87df-4d9b-87e7-08cf94601a74 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:46:01.560995 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41187217-87df-4d9b-87e7-08cf94601a74 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:01.561453 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41187217-87df-4d9b-87e7-08cf94601a74 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:01.562301 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41187217-87df-4d9b-87e7-08cf94601a74 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:01.562740 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41187217-87df-4d9b-87e7-08cf94601a74 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:01.580077 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-41187217-87df-4d9b-87e7-08cf94601a74 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Getting quotas for project 8c64dae61ceb4d9280a759bf3f111c80. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:46:01.584344 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-41187217-87df-4d9b-87e7-08cf94601a74 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Getting quotas for user 192b688b02c6455dbc4cdb22e7023521 and project 8c64dae61ceb4d9280a759bf3f111c80. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:46:01.641835 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-41187217-87df-4d9b-87e7-08cf94601a74 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:46:01.644026 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-41187217-87df-4d9b-87e7-08cf94601a74 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d4ef5645-7a09-4eed-8c58-549891c3c551',volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:46:01.784169 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-41187217-87df-4d9b-87e7-08cf94601a74 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.829506 Dec 15 14:46:01.785165 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1221/2362] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Dec 15 14:46:00 2021] POST /compute/v2.1/servers => generated 404 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:46:01.794586 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41f2c873-fa48-4b32-a1ab-8c665c803ff6] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 14:46:01.798516 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-10813da9-2368-4e7e-9d86-d9f91580c0a4 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:46:01.799129 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-10813da9-2368-4e7e-9d86-d9f91580c0a4 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:46:01.856255 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-10813da9-2368-4e7e-9d86-d9f91580c0a4 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:46:01.863216 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-10813da9-2368-4e7e-9d86-d9f91580c0a4 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 200 len: 1093 microversion: 2.1 time: 0.070672 Dec 15 14:46:01.863834 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1142/2363] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:46:01 2021] GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:46:02.891807 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7f84da7a-c210-4545-93c5-a18004a7348a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:46:02.893447 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7f84da7a-c210-4545-93c5-a18004a7348a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:46:02.903596 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7f84da7a-c210-4545-93c5-a18004a7348a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:02.904126 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7f84da7a-c210-4545-93c5-a18004a7348a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:02.905012 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7f84da7a-c210-4545-93c5-a18004a7348a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:02.905319 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7f84da7a-c210-4545-93c5-a18004a7348a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:02.915732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] [95a38445-d847-45c9-bd16-30efac0beb8d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 59740. Dec 15 14:46:03.017686 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7f84da7a-c210-4545-93c5-a18004a7348a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:46:03.025889 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7f84da7a-c210-4545-93c5-a18004a7348a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 200 len: 1199 microversion: 2.1 time: 0.148904 Dec 15 14:46:03.026706 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1222/2364] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:46:02 2021] GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 1199 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:46:04.044462 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3547a317-8fd5-487a-b976-6d15f0889d4b tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:46:04.045097 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3547a317-8fd5-487a-b976-6d15f0889d4b tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:46:04.069050 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] [41f2c873-fa48-4b32-a1ab-8c665c803ff6] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 59744. Dec 15 14:46:04.071850 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3547a317-8fd5-487a-b976-6d15f0889d4b tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:04.072358 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3547a317-8fd5-487a-b976-6d15f0889d4b tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:04.073194 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3547a317-8fd5-487a-b976-6d15f0889d4b tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:04.073641 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3547a317-8fd5-487a-b976-6d15f0889d4b tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:04.316716 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3547a317-8fd5-487a-b976-6d15f0889d4b tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:46:04.324977 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3547a317-8fd5-487a-b976-6d15f0889d4b tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 200 len: 1263 microversion: 2.1 time: 0.284602 Dec 15 14:46:04.335060 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1143/2365] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:46:04 2021] GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 1263 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:46:04.625135 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-fa795391-414e-4f96-967b-5e200e7ab67d req-7c9a9de6-5e9b-4d84-bf2e-98497c08eed4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b4e896a-b904-4a99-9d20-347f22121126", "tag": "402e33b3-46ad-4c3b-b2be-a9a36df093f4"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:46:04.627656 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:46:04.627656 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 15 14:46:04.635551 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-fa795391-414e-4f96-967b-5e200e7ab67d req-7c9a9de6-5e9b-4d84-bf2e-98497c08eed4 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:04.636002 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-fa795391-414e-4f96-967b-5e200e7ab67d req-7c9a9de6-5e9b-4d84-bf2e-98497c08eed4 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:04.647618 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-fa795391-414e-4f96-967b-5e200e7ab67d req-7c9a9de6-5e9b-4d84-bf2e-98497c08eed4 service nova] Creating event network-changed:402e33b3-46ad-4c3b-b2be-a9a36df093f4 for instance 2b4e896a-b904-4a99-9d20-347f22121126 on hv-cinder-82182 Dec 15 14:46:04.653633 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-fa795391-414e-4f96-967b-5e200e7ab67d req-7c9a9de6-5e9b-4d84-bf2e-98497c08eed4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118261 Dec 15 14:46:04.654482 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1223/2366] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:46:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:46:05.343082 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c3d7bc73-f29b-4993-8e95-a43c9b56a73f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:46:05.343808 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c3d7bc73-f29b-4993-8e95-a43c9b56a73f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:46:05.350768 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3d7bc73-f29b-4993-8e95-a43c9b56a73f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:05.351222 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3d7bc73-f29b-4993-8e95-a43c9b56a73f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:05.352049 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3d7bc73-f29b-4993-8e95-a43c9b56a73f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:05.352556 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3d7bc73-f29b-4993-8e95-a43c9b56a73f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:05.608930 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c3d7bc73-f29b-4993-8e95-a43c9b56a73f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:46:05.618842 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c3d7bc73-f29b-4993-8e95-a43c9b56a73f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 200 len: 1263 microversion: 2.1 time: 0.278890 Dec 15 14:46:05.619688 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1144/2367] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:46:05 2021] GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 1263 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:46:06.644245 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-668ad003-2dba-435c-acdb-fdd9d7d4c82a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:46:06.645169 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-668ad003-2dba-435c-acdb-fdd9d7d4c82a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:46:06.652264 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-668ad003-2dba-435c-acdb-fdd9d7d4c82a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:06.652703 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-668ad003-2dba-435c-acdb-fdd9d7d4c82a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:06.653489 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-668ad003-2dba-435c-acdb-fdd9d7d4c82a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:06.654024 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-668ad003-2dba-435c-acdb-fdd9d7d4c82a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:06.809941 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-668ad003-2dba-435c-acdb-fdd9d7d4c82a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:46:06.818138 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-668ad003-2dba-435c-acdb-fdd9d7d4c82a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 200 len: 1263 microversion: 2.1 time: 0.184979 Dec 15 14:46:06.818687 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1224/2368] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:46:06 2021] GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 1263 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:46:07.838239 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a61b99f4-6bd2-4bf5-96a5-e86bf63787f5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:46:07.839132 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a61b99f4-6bd2-4bf5-96a5-e86bf63787f5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:46:07.847200 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a61b99f4-6bd2-4bf5-96a5-e86bf63787f5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:07.847675 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a61b99f4-6bd2-4bf5-96a5-e86bf63787f5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:07.848492 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a61b99f4-6bd2-4bf5-96a5-e86bf63787f5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:07.849006 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a61b99f4-6bd2-4bf5-96a5-e86bf63787f5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:07.989470 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a61b99f4-6bd2-4bf5-96a5-e86bf63787f5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:46:07.998294 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a61b99f4-6bd2-4bf5-96a5-e86bf63787f5 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 200 len: 1263 microversion: 2.1 time: 0.165517 Dec 15 14:46:07.998852 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1145/2369] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:46:07 2021] GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:46:09.017587 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c727f006-9fcf-468a-91af-8c39c604ef8c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:46:09.018683 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c727f006-9fcf-468a-91af-8c39c604ef8c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:46:09.029782 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c727f006-9fcf-468a-91af-8c39c604ef8c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:09.030443 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c727f006-9fcf-468a-91af-8c39c604ef8c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:09.032072 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c727f006-9fcf-468a-91af-8c39c604ef8c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:09.032793 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c727f006-9fcf-468a-91af-8c39c604ef8c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:09.182207 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c727f006-9fcf-468a-91af-8c39c604ef8c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:46:09.190184 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c727f006-9fcf-468a-91af-8c39c604ef8c tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 200 len: 1263 microversion: 2.1 time: 0.176684 Dec 15 14:46:09.190741 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1225/2370] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:46:09 2021] GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 1263 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:46:10.214212 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bbf262af-0d11-4128-ac2c-024e7a865c67 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:46:10.214836 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bbf262af-0d11-4128-ac2c-024e7a865c67 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:46:10.221710 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbf262af-0d11-4128-ac2c-024e7a865c67 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:10.222159 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbf262af-0d11-4128-ac2c-024e7a865c67 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:10.223144 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbf262af-0d11-4128-ac2c-024e7a865c67 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:10.223404 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbf262af-0d11-4128-ac2c-024e7a865c67 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:10.379756 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bbf262af-0d11-4128-ac2c-024e7a865c67 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:46:10.387830 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bbf262af-0d11-4128-ac2c-024e7a865c67 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 200 len: 1263 microversion: 2.1 time: 0.179862 Dec 15 14:46:10.388379 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1146/2371] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:46:10 2021] GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 1263 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:46:11.405256 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-55334458-21f2-433f-ae07-c2a8c9096f5a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:46:11.406214 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-55334458-21f2-433f-ae07-c2a8c9096f5a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:46:11.413040 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55334458-21f2-433f-ae07-c2a8c9096f5a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:11.413487 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55334458-21f2-433f-ae07-c2a8c9096f5a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:11.414443 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55334458-21f2-433f-ae07-c2a8c9096f5a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:11.414831 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55334458-21f2-433f-ae07-c2a8c9096f5a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:11.552301 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-55334458-21f2-433f-ae07-c2a8c9096f5a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:46:11.560480 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-55334458-21f2-433f-ae07-c2a8c9096f5a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 200 len: 1263 microversion: 2.1 time: 0.159098 Dec 15 14:46:11.561030 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1226/2372] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:46:11 2021] GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:46:12.577716 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c2d52570-1a7e-4828-9a19-2d94b558118f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:46:12.578339 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c2d52570-1a7e-4828-9a19-2d94b558118f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:46:12.585655 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c2d52570-1a7e-4828-9a19-2d94b558118f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:12.586099 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c2d52570-1a7e-4828-9a19-2d94b558118f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:12.587220 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c2d52570-1a7e-4828-9a19-2d94b558118f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:12.587737 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c2d52570-1a7e-4828-9a19-2d94b558118f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:12.740718 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c2d52570-1a7e-4828-9a19-2d94b558118f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:46:12.751651 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c2d52570-1a7e-4828-9a19-2d94b558118f tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 200 len: 1263 microversion: 2.1 time: 0.177655 Dec 15 14:46:12.752294 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1147/2373] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:46:12 2021] GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 1263 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:46:13.772831 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b6393add-65f3-487d-a3d0-4ca57b742ab0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:46:13.773506 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b6393add-65f3-487d-a3d0-4ca57b742ab0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:46:13.780147 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b6393add-65f3-487d-a3d0-4ca57b742ab0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:13.780600 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b6393add-65f3-487d-a3d0-4ca57b742ab0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:13.782026 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b6393add-65f3-487d-a3d0-4ca57b742ab0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:13.782718 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b6393add-65f3-487d-a3d0-4ca57b742ab0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:13.942163 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b6393add-65f3-487d-a3d0-4ca57b742ab0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:46:13.950619 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b6393add-65f3-487d-a3d0-4ca57b742ab0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 200 len: 1263 microversion: 2.1 time: 0.184712 Dec 15 14:46:13.951214 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1227/2374] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:46:13 2021] GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 1263 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:46:14.968203 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b8359e18-fe4d-4fbf-97e4-0f9f16ecce05 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:46:14.968751 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b8359e18-fe4d-4fbf-97e4-0f9f16ecce05 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:46:14.975984 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8359e18-fe4d-4fbf-97e4-0f9f16ecce05 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:14.976760 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8359e18-fe4d-4fbf-97e4-0f9f16ecce05 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:14.978202 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8359e18-fe4d-4fbf-97e4-0f9f16ecce05 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:14.978997 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8359e18-fe4d-4fbf-97e4-0f9f16ecce05 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:15.138012 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b8359e18-fe4d-4fbf-97e4-0f9f16ecce05 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:46:15.145698 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b8359e18-fe4d-4fbf-97e4-0f9f16ecce05 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 200 len: 1263 microversion: 2.1 time: 0.181376 Dec 15 14:46:15.146285 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1148/2375] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:46:14 2021] GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 1263 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:46:16.163561 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-90c2a9a3-9350-470d-8885-97be8dd8e981 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:46:16.164193 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-90c2a9a3-9350-470d-8885-97be8dd8e981 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:46:16.171221 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90c2a9a3-9350-470d-8885-97be8dd8e981 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:16.171682 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90c2a9a3-9350-470d-8885-97be8dd8e981 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:16.172483 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90c2a9a3-9350-470d-8885-97be8dd8e981 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:16.172933 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90c2a9a3-9350-470d-8885-97be8dd8e981 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:16.326301 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-90c2a9a3-9350-470d-8885-97be8dd8e981 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:46:16.334090 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-90c2a9a3-9350-470d-8885-97be8dd8e981 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 200 len: 1263 microversion: 2.1 time: 0.174481 Dec 15 14:46:16.334674 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1228/2376] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:46:16 2021] GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 1263 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:46:16.689480 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-65cd257d-b664-4161-ac5e-82523c050f0d req-47a00b43-ca51-45e7-b9b0-2b218a375b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b4e896a-b904-4a99-9d20-347f22121126", "name": "network-vif-plugged", "status": "completed", "tag": "402e33b3-46ad-4c3b-b2be-a9a36df093f4"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:46:16.691120 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:46:16.691120 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:46:16.698853 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-65cd257d-b664-4161-ac5e-82523c050f0d req-47a00b43-ca51-45e7-b9b0-2b218a375b95 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:16.699296 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-65cd257d-b664-4161-ac5e-82523c050f0d req-47a00b43-ca51-45e7-b9b0-2b218a375b95 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:16.711294 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-65cd257d-b664-4161-ac5e-82523c050f0d req-47a00b43-ca51-45e7-b9b0-2b218a375b95 service nova] Creating event network-vif-plugged:402e33b3-46ad-4c3b-b2be-a9a36df093f4 for instance 2b4e896a-b904-4a99-9d20-347f22121126 on hv-cinder-82182 Dec 15 14:46:16.717053 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-65cd257d-b664-4161-ac5e-82523c050f0d req-47a00b43-ca51-45e7-b9b0-2b218a375b95 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097127 Dec 15 14:46:16.717723 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1149/2377] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:46:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:46:17.351222 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a59f2901-8e13-479e-af78-13e7d3d70a0a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:46:17.351833 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a59f2901-8e13-479e-af78-13e7d3d70a0a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:46:17.358678 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a59f2901-8e13-479e-af78-13e7d3d70a0a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:17.359139 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a59f2901-8e13-479e-af78-13e7d3d70a0a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:17.359923 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a59f2901-8e13-479e-af78-13e7d3d70a0a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:17.360362 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a59f2901-8e13-479e-af78-13e7d3d70a0a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:17.505779 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a59f2901-8e13-479e-af78-13e7d3d70a0a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:46:17.513881 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a59f2901-8e13-479e-af78-13e7d3d70a0a tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 200 len: 1263 microversion: 2.1 time: 0.166375 Dec 15 14:46:17.514450 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1229/2378] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:46:17 2021] GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:46:18.532716 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c39d5f2d-b9b3-4244-ad8d-6ad77848f251 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:46:18.533410 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c39d5f2d-b9b3-4244-ad8d-6ad77848f251 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:46:18.540347 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c39d5f2d-b9b3-4244-ad8d-6ad77848f251 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:18.541010 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c39d5f2d-b9b3-4244-ad8d-6ad77848f251 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:18.542084 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c39d5f2d-b9b3-4244-ad8d-6ad77848f251 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:18.542517 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c39d5f2d-b9b3-4244-ad8d-6ad77848f251 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:18.686782 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c39d5f2d-b9b3-4244-ad8d-6ad77848f251 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:46:18.694795 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c39d5f2d-b9b3-4244-ad8d-6ad77848f251 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 200 len: 1450 microversion: 2.1 time: 0.166982 Dec 15 14:46:18.695425 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1150/2379] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:46:18 2021] GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 1450 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:46:18.712976 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c0da551e-aebe-4124-99fe-fc3235ded0a2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:46:18.713579 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c0da551e-aebe-4124-99fe-fc3235ded0a2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:46:18.720684 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0da551e-aebe-4124-99fe-fc3235ded0a2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:18.721135 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0da551e-aebe-4124-99fe-fc3235ded0a2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:18.721992 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0da551e-aebe-4124-99fe-fc3235ded0a2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:18.722410 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0da551e-aebe-4124-99fe-fc3235ded0a2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:18.871882 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c0da551e-aebe-4124-99fe-fc3235ded0a2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:46:18.880574 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c0da551e-aebe-4124-99fe-fc3235ded0a2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 200 len: 1450 microversion: 2.1 time: 0.171679 Dec 15 14:46:18.881076 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1230/2380] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:46:18 2021] GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 1450 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:46:21.060409 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-6371d596-badc-4b5f-8c09-75ad1909a5fe req-8f5b5a0a-e8d2-4c63-9792-33d1a28a3cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b4e896a-b904-4a99-9d20-347f22121126", "tag": "402e33b3-46ad-4c3b-b2be-a9a36df093f4"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:46:21.062757 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:46:21.062757 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:46:21.070369 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-6371d596-badc-4b5f-8c09-75ad1909a5fe req-8f5b5a0a-e8d2-4c63-9792-33d1a28a3cd5 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:46:21.070804 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-6371d596-badc-4b5f-8c09-75ad1909a5fe req-8f5b5a0a-e8d2-4c63-9792-33d1a28a3cd5 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:46:21.083358 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-6371d596-badc-4b5f-8c09-75ad1909a5fe req-8f5b5a0a-e8d2-4c63-9792-33d1a28a3cd5 service nova] Creating event network-changed:402e33b3-46ad-4c3b-b2be-a9a36df093f4 for instance 2b4e896a-b904-4a99-9d20-347f22121126 on hv-cinder-82182 Dec 15 14:46:21.092728 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-6371d596-badc-4b5f-8c09-75ad1909a5fe req-8f5b5a0a-e8d2-4c63-9792-33d1a28a3cd5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038480 Dec 15 14:46:21.093380 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1151/2381] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:46:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:46:49.622722 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:46:49.623407 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:46:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:46:51.206365 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:46:51.207122 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:46:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:48:12.106380 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-756d4260-e83f-4a68-b45e-66ef67e2bfb0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:48:12.106962 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-756d4260-e83f-4a68-b45e-66ef67e2bfb0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:48:12.107445 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41f2c873-fa48-4b32-a1ab-8c665c803ff6] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 15 14:48:12.111530 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-0aac6ff6-550d-4051-94dc-538cda72d967 req-989b30c4-3094-431d-bc57-a74c6bc40263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b4e896a-b904-4a99-9d20-347f22121126", "tag": "402e33b3-46ad-4c3b-b2be-a9a36df093f4"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:48:12.113034 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:48:12.113034 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:48:12.113590 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-756d4260-e83f-4a68-b45e-66ef67e2bfb0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:12.114141 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-756d4260-e83f-4a68-b45e-66ef67e2bfb0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:12.115005 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-756d4260-e83f-4a68-b45e-66ef67e2bfb0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:12.115668 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-756d4260-e83f-4a68-b45e-66ef67e2bfb0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:12.121138 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-0aac6ff6-550d-4051-94dc-538cda72d967 req-989b30c4-3094-431d-bc57-a74c6bc40263 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:12.121585 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-0aac6ff6-550d-4051-94dc-538cda72d967 req-989b30c4-3094-431d-bc57-a74c6bc40263 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:12.132750 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-0aac6ff6-550d-4051-94dc-538cda72d967 req-989b30c4-3094-431d-bc57-a74c6bc40263 service nova] Creating event network-changed:402e33b3-46ad-4c3b-b2be-a9a36df093f4 for instance 2b4e896a-b904-4a99-9d20-347f22121126 on hv-cinder-82182 Dec 15 14:48:12.138740 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-0aac6ff6-550d-4051-94dc-538cda72d967 req-989b30c4-3094-431d-bc57-a74c6bc40263 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034443 Dec 15 14:48:12.139549 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1152/2382] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:48:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:48:12.143010 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-756d4260-e83f-4a68-b45e-66ef67e2bfb0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:48:12.243228 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-756d4260-e83f-4a68-b45e-66ef67e2bfb0 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 204 len: 0 microversion: 2.1 time: 0.141707 Dec 15 14:48:12.244309 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1231/2383] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:48:12 2021] DELETE /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:48:12.253673 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bb342208-285d-4a84-8f28-230673087a18 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:48:12.254442 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bb342208-285d-4a84-8f28-230673087a18 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:48:12.260894 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb342208-285d-4a84-8f28-230673087a18 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:12.261431 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb342208-285d-4a84-8f28-230673087a18 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:12.262358 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb342208-285d-4a84-8f28-230673087a18 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:12.262866 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb342208-285d-4a84-8f28-230673087a18 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:12.502862 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bb342208-285d-4a84-8f28-230673087a18 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:48:12.512446 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bb342208-285d-4a84-8f28-230673087a18 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 200 len: 1575 microversion: 2.1 time: 0.263011 Dec 15 14:48:12.513072 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1153/2384] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:48:12 2021] GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 1575 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:48:13.534725 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8d029be3-c4f8-4d5f-9bc5-4bcd21a432ae tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:48:13.535898 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8d029be3-c4f8-4d5f-9bc5-4bcd21a432ae tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:48:13.544358 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8d029be3-c4f8-4d5f-9bc5-4bcd21a432ae tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:13.544583 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8d029be3-c4f8-4d5f-9bc5-4bcd21a432ae tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:13.545292 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8d029be3-c4f8-4d5f-9bc5-4bcd21a432ae tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:13.545769 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8d029be3-c4f8-4d5f-9bc5-4bcd21a432ae tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:13.712599 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8d029be3-c4f8-4d5f-9bc5-4bcd21a432ae tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:48:13.725275 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8d029be3-c4f8-4d5f-9bc5-4bcd21a432ae tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 200 len: 1456 microversion: 2.1 time: 0.197866 Dec 15 14:48:13.725892 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1232/2385] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:48:13 2021] GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 1456 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:48:14.637415 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-efb7bfa4-0ca6-41fb-af46-cfd84d0fe92d req-65f65749-bfda-48c1-b607-d004cb735b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b4e896a-b904-4a99-9d20-347f22121126", "name": "network-vif-deleted", "tag": "402e33b3-46ad-4c3b-b2be-a9a36df093f4"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:48:14.638896 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:48:14.638896 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:48:14.657149 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-efb7bfa4-0ca6-41fb-af46-cfd84d0fe92d req-65f65749-bfda-48c1-b607-d004cb735b03 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:14.657633 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-efb7bfa4-0ca6-41fb-af46-cfd84d0fe92d req-65f65749-bfda-48c1-b607-d004cb735b03 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:14.670557 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-efb7bfa4-0ca6-41fb-af46-cfd84d0fe92d req-65f65749-bfda-48c1-b607-d004cb735b03 service nova] Creating event network-vif-deleted:402e33b3-46ad-4c3b-b2be-a9a36df093f4 for instance 2b4e896a-b904-4a99-9d20-347f22121126 on hv-cinder-82182 Dec 15 14:48:14.675555 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-efb7bfa4-0ca6-41fb-af46-cfd84d0fe92d req-65f65749-bfda-48c1-b607-d004cb735b03 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042001 Dec 15 14:48:14.676160 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1154/2386] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:48:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:48:14.746249 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-99835b02-a24c-4b3a-87b8-a15c8213c4a6 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:48:14.746842 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-99835b02-a24c-4b3a-87b8-a15c8213c4a6 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:48:14.753644 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99835b02-a24c-4b3a-87b8-a15c8213c4a6 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:14.754206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99835b02-a24c-4b3a-87b8-a15c8213c4a6 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:14.755031 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99835b02-a24c-4b3a-87b8-a15c8213c4a6 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:14.755448 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99835b02-a24c-4b3a-87b8-a15c8213c4a6 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:14.821678 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-99835b02-a24c-4b3a-87b8-a15c8213c4a6 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:48:14.829751 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-99835b02-a24c-4b3a-87b8-a15c8213c4a6 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 200 len: 1224 microversion: 2.1 time: 0.087651 Dec 15 14:48:14.830316 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1233/2387] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:48:14 2021] GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:48:15.845646 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] [41f2c873-fa48-4b32-a1ab-8c665c803ff6] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 59842. Dec 15 14:48:15.849507 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bc4ee1a9-fc5d-439d-9188-0b37d0941294 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:48:15.850234 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bc4ee1a9-fc5d-439d-9188-0b37d0941294 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 2b4e896a-b904-4a99-9d20-347f22121126] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:48:15.857351 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc4ee1a9-fc5d-439d-9188-0b37d0941294 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:15.857830 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc4ee1a9-fc5d-439d-9188-0b37d0941294 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:15.858650 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc4ee1a9-fc5d-439d-9188-0b37d0941294 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:15.859092 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc4ee1a9-fc5d-439d-9188-0b37d0941294 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:15.873453 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-bc4ee1a9-fc5d-439d-9188-0b37d0941294 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] HTTP exception thrown: Instance 2b4e896a-b904-4a99-9d20-347f22121126 could not be found. Dec 15 14:48:15.874145 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bc4ee1a9-fc5d-439d-9188-0b37d0941294 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Returning 404 to user: Instance 2b4e896a-b904-4a99-9d20-347f22121126 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:48:15.874985 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bc4ee1a9-fc5d-439d-9188-0b37d0941294 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126" status: 404 len: 111 microversion: 2.1 time: 0.030562 Dec 15 14:48:15.875742 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1155/2388] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:48:15 2021] GET /compute/v2.1/servers/2b4e896a-b904-4a99-9d20-347f22121126 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:48:19.053009 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f53b92b0-c837-47ff-95b5-73db2d7e4c32 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:48:19.053581 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f53b92b0-c837-47ff-95b5-73db2d7e4c32 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:48:19.061433 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f53b92b0-c837-47ff-95b5-73db2d7e4c32 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:19.061976 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f53b92b0-c837-47ff-95b5-73db2d7e4c32 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:19.062840 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f53b92b0-c837-47ff-95b5-73db2d7e4c32 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:19.063339 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f53b92b0-c837-47ff-95b5-73db2d7e4c32 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:19.090715 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f53b92b0-c837-47ff-95b5-73db2d7e4c32 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:48:19.176571 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f53b92b0-c837-47ff-95b5-73db2d7e4c32 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "DELETE /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 204 len: 0 microversion: 2.1 time: 0.126952 Dec 15 14:48:19.177263 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1234/2389] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:48:19 2021] DELETE /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:48:19.177403 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-22d0d5f8-346b-420e-adc9-aaa266a611d9 req-b68bd329-6c75-45a8-b6ff-6cd40b9376e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48676f0f-3fe3-4e9f-a5ba-4225782ebbb3", "tag": "6dfdb681-f711-44d8-a4f8-8926272320ac"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:48:19.182301 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:48:19.182301 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:48:19.186133 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6b9c7291-e179-4301-9a86-03cfaa35fdd2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:48:19.186822 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6b9c7291-e179-4301-9a86-03cfaa35fdd2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:48:19.193255 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-22d0d5f8-346b-420e-adc9-aaa266a611d9 req-b68bd329-6c75-45a8-b6ff-6cd40b9376e1 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:19.193448 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6b9c7291-e179-4301-9a86-03cfaa35fdd2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:19.193837 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6b9c7291-e179-4301-9a86-03cfaa35fdd2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:19.194620 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6b9c7291-e179-4301-9a86-03cfaa35fdd2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:19.195206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6b9c7291-e179-4301-9a86-03cfaa35fdd2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:19.195937 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-22d0d5f8-346b-420e-adc9-aaa266a611d9 req-b68bd329-6c75-45a8-b6ff-6cd40b9376e1 service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:19.208645 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-22d0d5f8-346b-420e-adc9-aaa266a611d9 req-b68bd329-6c75-45a8-b6ff-6cd40b9376e1 service nova] Creating event network-changed:6dfdb681-f711-44d8-a4f8-8926272320ac for instance 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 on hv-cinder-82182 Dec 15 14:48:19.214119 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-22d0d5f8-346b-420e-adc9-aaa266a611d9 req-b68bd329-6c75-45a8-b6ff-6cd40b9376e1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162261 Dec 15 14:48:19.214810 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1156/2390] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:48:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:48:19.385244 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6b9c7291-e179-4301-9a86-03cfaa35fdd2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:48:19.393756 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6b9c7291-e179-4301-9a86-03cfaa35fdd2 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1574 microversion: 2.1 time: 0.211595 Dec 15 14:48:19.394831 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1235/2391] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:48:19 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1574 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:48:20.415789 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-83905ae5-0d48-4ee2-8a67-5d667f3a1b70 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:48:20.416492 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-83905ae5-0d48-4ee2-8a67-5d667f3a1b70 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:48:20.422986 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83905ae5-0d48-4ee2-8a67-5d667f3a1b70 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:20.423442 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83905ae5-0d48-4ee2-8a67-5d667f3a1b70 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:20.424228 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83905ae5-0d48-4ee2-8a67-5d667f3a1b70 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:20.424667 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83905ae5-0d48-4ee2-8a67-5d667f3a1b70 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:20.586888 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-83905ae5-0d48-4ee2-8a67-5d667f3a1b70 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:48:20.594742 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-83905ae5-0d48-4ee2-8a67-5d667f3a1b70 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1456 microversion: 2.1 time: 0.185634 Dec 15 14:48:20.595291 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1157/2392] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:48:20 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1456 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:48:21.612572 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b30d8874-256e-4d87-9808-107aa0d11d55 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:48:21.613201 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b30d8874-256e-4d87-9808-107aa0d11d55 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:48:21.621527 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b30d8874-256e-4d87-9808-107aa0d11d55 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:21.622115 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b30d8874-256e-4d87-9808-107aa0d11d55 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:21.622919 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b30d8874-256e-4d87-9808-107aa0d11d55 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:21.623362 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b30d8874-256e-4d87-9808-107aa0d11d55 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:21.869067 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-8013ba3c-ebe2-4017-825c-88026061ee8a req-9cbd9d95-d98e-4e42-accc-2880bfcc928c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48676f0f-3fe3-4e9f-a5ba-4225782ebbb3", "name": "network-vif-deleted", "tag": "6dfdb681-f711-44d8-a4f8-8926272320ac"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:48:21.870860 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:48:21.870860 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Dec 15 14:48:21.884685 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-8013ba3c-ebe2-4017-825c-88026061ee8a req-9cbd9d95-d98e-4e42-accc-2880bfcc928c service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:21.886000 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-8013ba3c-ebe2-4017-825c-88026061ee8a req-9cbd9d95-d98e-4e42-accc-2880bfcc928c service nova] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:21.888003 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b30d8874-256e-4d87-9808-107aa0d11d55 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192b688b02c6455dbc4cdb22e7023521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c64dae61ceb4d9280a759bf3f111c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:48:21.899867 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b30d8874-256e-4d87-9808-107aa0d11d55 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 200 len: 1390 microversion: 2.1 time: 0.291089 Dec 15 14:48:21.900570 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1236/2393] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:48:21 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 1390 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:48:21.907029 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-8013ba3c-ebe2-4017-825c-88026061ee8a req-9cbd9d95-d98e-4e42-accc-2880bfcc928c service nova] Creating event network-vif-deleted:6dfdb681-f711-44d8-a4f8-8926272320ac for instance 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 on hv-cinder-82182 Dec 15 14:48:21.909343 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-8013ba3c-ebe2-4017-825c-88026061ee8a req-9cbd9d95-d98e-4e42-accc-2880bfcc928c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044345 Dec 15 14:48:21.910068 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1158/2394] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Dec 15 14:48:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:48:22.918095 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4a1882cc-e664-4f2c-9020-92c5d1021eef tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:48:22.918732 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4a1882cc-e664-4f2c-9020-92c5d1021eef tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:48:22.925250 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a1882cc-e664-4f2c-9020-92c5d1021eef tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:22.925745 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a1882cc-e664-4f2c-9020-92c5d1021eef tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:22.926525 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a1882cc-e664-4f2c-9020-92c5d1021eef tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:22.926960 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a1882cc-e664-4f2c-9020-92c5d1021eef tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:22.941159 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-4a1882cc-e664-4f2c-9020-92c5d1021eef tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] HTTP exception thrown: Instance 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 could not be found. Dec 15 14:48:22.941855 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4a1882cc-e664-4f2c-9020-92c5d1021eef tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Returning 404 to user: Instance 48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:48:22.942707 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4a1882cc-e664-4f2c-9020-92c5d1021eef tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3" status: 404 len: 111 microversion: 2.1 time: 0.028391 Dec 15 14:48:22.943235 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1237/2395] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:48:22 2021] GET /compute/v2.1/servers/48676f0f-3fe3-4e9f-a5ba-4225782ebbb3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:48:22.976070 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:48:22.976525 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:48:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:48:23.410033 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2849fb82-be3c-4537-85c5-80032a34509b tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:48:23.410619 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2849fb82-be3c-4537-85c5-80032a34509b tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:48:23.417595 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2849fb82-be3c-4537-85c5-80032a34509b tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:23.418075 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2849fb82-be3c-4537-85c5-80032a34509b tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:23.418857 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2849fb82-be3c-4537-85c5-80032a34509b tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:23.419299 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2849fb82-be3c-4537-85c5-80032a34509b tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:23.432483 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-2849fb82-be3c-4537-85c5-80032a34509b tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] HTTP exception thrown: Instance 8115b3e6-ac36-405e-a868-eea90e723391 could not be found. Dec 15 14:48:23.433065 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2849fb82-be3c-4537-85c5-80032a34509b tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Returning 404 to user: Instance 8115b3e6-ac36-405e-a868-eea90e723391 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:48:23.433920 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2849fb82-be3c-4537-85c5-80032a34509b tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 404 len: 111 microversion: 2.1 time: 0.028068 Dec 15 14:48:23.434454 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1159/2396] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Dec 15 14:48:23 2021] DELETE /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:48:23.442566 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7ed198b5-26df-4003-bb69-33de33c8f1cf tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:48:23.443287 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7ed198b5-26df-4003-bb69-33de33c8f1cf tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] [instance: 8115b3e6-ac36-405e-a868-eea90e723391] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:48:23.449761 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7ed198b5-26df-4003-bb69-33de33c8f1cf tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:23.450206 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7ed198b5-26df-4003-bb69-33de33c8f1cf tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:23.450966 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7ed198b5-26df-4003-bb69-33de33c8f1cf tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:48:23.451395 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7ed198b5-26df-4003-bb69-33de33c8f1cf tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Lock "ff103318-e65e-4db9-8afc-ec27a2dfc0ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:48:23.465094 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-7ed198b5-26df-4003-bb69-33de33c8f1cf tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] HTTP exception thrown: Instance 8115b3e6-ac36-405e-a868-eea90e723391 could not be found. Dec 15 14:48:23.465705 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7ed198b5-26df-4003-bb69-33de33c8f1cf tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Returning 404 to user: Instance 8115b3e6-ac36-405e-a868-eea90e723391 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:48:23.466544 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7ed198b5-26df-4003-bb69-33de33c8f1cf tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391" status: 404 len: 111 microversion: 2.1 time: 0.027722 Dec 15 14:48:23.467072 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1238/2397] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Dec 15 14:48:23 2021] GET /compute/v2.1/servers/8115b3e6-ac36-405e-a868-eea90e723391 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:48:24.771627 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-04cbccbf-33c0-49bf-984b-0ab62293a164 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] Calling method '.version_select at 0x7faa3c58dee0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:48:24.801794 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-04cbccbf-33c0-49bf-984b-0ab62293a164 tempest-TestVolumeBootPattern-492117320 tempest-TestVolumeBootPattern-492117320-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-567869390" status: 202 len: 0 microversion: 2.1 time: 0.034209 Dec 15 14:48:24.802390 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1160/2398] 10.222.0.42 () {58 vars in 1259 bytes} [Wed Dec 15 14:48:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-567869390 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:48:29.178479 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:48:29.179050 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:48:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:50:11.225746 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:50:11.226476 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:50:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:51:42.994947 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:51:42.995877 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:51:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:51:49.197512 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:51:49.198217 dv-cinder-821824-1-iscsi devstack@n-api.service[116104]: Wed Dec 15 14:51:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:53:29.645842 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:53:29.646847 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:53:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:53:31.244842 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:53:31.245877 dv-cinder-821824-1-iscsi devstack@n-api.service[116103]: Wed Dec 15 14:53:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!